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Abstract. We study self-programming in recurrent neural networks where both 
neurons (the 'processors') and synaptic interactions ('the programme') evolve in 
time simultaneously, according to specific coupled stochastic equations. The 
interactions are divided into a hierarchy of L groups with adiabatically separated 
and monotonically increasing time-scales, representing sub-routines of the system 
programme of decreasing volatility. We solve this model in equilibrium, assuming 
ergodicity at every level, and find as our replica-symmetric solution a formalism with a 
structure similar but not identical to Parisi's L-step replica symmetry breaking scheme. 
Apart from differences in details of the equations (due to the fact that here interactions, 
rather than spins, are grouped into clusters with different time-scales), in the present 
model the block sizes rrii of the emerging ultrametric solution are not restricted to the 
interval [0, 1], but are independent control parameters, defined in terms of the noise 
strengths of the various levels in the hierarchy, which can take any value in [0, oo). 
This is shown to lead to extremely rich phase diagrams, with an abundance of first- 
order transitions especially when the level of stochasticity in the interaction dynamics 
is chosen to be low. 
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1. Introduction 

In this paper we study recurrent networks of binary neuronal state variables, represented 
as Ising spins, with symmetric couphngs (or synaptic interactions) Jjj, taken to be of 
infinite range. In contrast to most standard neural network models, not only the neuron 
states but also the interactions are allowed to evolve in time (simultaneously), driven 
by correlations in the states of the neurons (albeit slowly compared to the dynamics of 
the latter), reflecting the effect of 'learning' or 'long-term potentiation' in real nervous 
tissue. Since the interactions represent the 'programme' of the system, and since the 
slow interaction dynamics are driven by the states of the neurons (the 'processors'), such 
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models can be regarded as describing self-programming information-processing systems, 
which can be expected to exhibit highly complex dynamical behaviour. 

The first papers in which self-programming recurrent neural networks were studied 
appear to be |1|, 0. In the language of self-programming systems one could say 
that these authors were mostly concerned with the stability properties of embedded 
'programmes' (usually taken to be those implementing content-addressable or associative 
memories). In both |]l], ^ the programme dynamics, i.e. that of the {Jij}-, was defined 
to be adiabatically slow compared to the neuronal dynamics, and fully deterministic. 
However, the authors already made the important observation that the natural type of 
(deterministic) programme dynamics (from a biological point of view), so-called Hebbian 
learning, could be written as a gradient descent of the interactions {Jij} on the free 
energy surface of a symmetric recurrent neural network equipped with these interactions. 

In order to study more generally the potential of such self-programming systems, 
several authors (simultaneously and independently) took the natural next step 0, |, 
S i; 0' il- ^^^y generalized the interaction dynamics by adding Gaussian white noise 
to the deterministic laws, converting the process into one described by conservative 
Langevin equations, and were thus able to set up an equilibrium statistical mechanics 
of the self-programming process. This was (surprisingly) found to take the form of 
a replica theory with finite replica dimension, whose value was given by the ratio of 
the noise levels in the neuronal dynamics and the interaction dynamics, respectively. 
Furthermore, adding explicit quenched disorder to the problem in the form of additional 
random (but frozen) forces in the interaction dynamics, led to theories with two nested 
levels of replicas, one representing the disorder (with zero replica dimension) and one 
representing the adiabatically slow dynamics of the interactions 0, ^, |1^] (with nonzero 
replica dimension). The structure of these latter theories was found to be more or less 
identical to those of ordinary disordered spin systems such as the SK model [l^, with 
fixed interactions but quenched disorder, when described by replica theories with one 
step replica symmetry breaking (RSB) |jl3|. The only (yet crucial) difference was that 
in ordinary disordered spin systems the size m of the level-1 block in the Parisi solution 
is determined by extremisation of the free energy, which forces m to lie in the interval 
[0,1] see also whereas in the self-programming neural networks of P, |^, |10| m 
was an independent control parameters, given by the ratio of two temperatures, which 
can take any non-zero value. As a consequence one can observe in the latter systems, 
for sufficiently large values of such dimensions, much more complicated scenarios of 
(generally discontinuous) phase transitions. 

In contrast to the previous models involving coupled dynamics of fast neurons 
and slow interactions, in this paper we study systems in which the interactions do 
not evolve on a single time-scale, but where they are divided into a hierarchy of L 
different groups, each with their own characteristic time-scale ti and noise level Ti 
[l = 1, . . . , L), describing a hierarchy of increasingly no n- volatile programming levels. 
This appears to be a much more realistic representation of self-programming systems; 
conventional programmes generally take the form of hierarchies of routines, sub-routines 
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Figure 1. Schematic illustration of the structure and ingredients of our recurrent 
self-programming model for L = 2. The binary spin variables (spin up: o, spin down: 
• ) evolve on time-scales of order 1. The level- 1 interactions (solid line segments) evolve 
on time-scales ti ^ 1. The level-2 interactions (dashed line segments) evolve on time- 
scales T2 ^ Ti. The interactions are randomly allocated to levels. Our present model 
differs from this simple picture in two ways: firstly, it is fully connected (i.e. infinite 
dimensional), and secondly, we allow for an arbitrary number L of interaction types. 



and so on, and it would appear appropriate to allow low-level sub-routines to be more 
easily modifiable than high-level ones. In order to retain analytical solvability we choose 
the different groups of interactions randomly (prescibing only their sizes), see figure 0. 
We solve the model in equilibrium, and find, upon making the replica-symmetric (i.e. 
ergodic) ansatz within each level of our hierarchy, a theory which resembles, but is not 
identical to Parisi's L-level replica symmetry breaking solution for spin systems with 
frozen disorder. Although Parisi's solution can also be traced back to the existence 



of a hierarchy of adiabatically separated time-scales in the present model the 



interactions are grouped into clusters with different time-scales, rather than the spins. 
Apart from quantitative differences in the details of the order parameter equations, a 
major consequence of this difference is that in the present model the block sizes mj 
of the emerging ultrametric solution are not restricted to the interval [0, 1], but are 
independent control parameters, defined in terms of the noise strengths of the various 
levels in the hierarchy. They can consequently take any value in the interval [0, oo). 
We show that this leads to extremely rich phase diagrams, with an abundance of first- 
order transitions especially when the level of stochasticity in the interaction dynamics 
is chosen to be low, i.e. when the dimensions {mi} become large. We study our model 
in full detail for the choices L = 2 and L = 3, including phase diagrams, and we study 
the asymptotic properties of our model in the limits mi — > oo for fixed T (deterministic 
dynamics of the level-1 interactions) and mi — for fixed Ti (deterministic dynamics 
of the neuronal processors), for arbitrary L. 
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2. Model Definitions 

In this paper we will refer to our binary neurons as spins and to the synaptic interactions 
as couplings. We will write the A^-spin state vector as cr = (cti, . . . .a^) G {—1, 1}^, 
and the matrix of interactions as J = {Jij}- The spins are taken to have a stochastic 
Glauber-type dynamics such that for stationary choices of the couplings the microscopic 
spin probability density would evolve towards a Boltzmann distribution 

p-l3H{a) 

pU-) = -^ Z = Ee^^^(^) (1) 

^ (7 

with the conventional Hamiltonian 

H{.ct) = ~Y1 Jij^^i^j (2) 

i<j 

where i, j G {1, . . . , A^}, and with the inverse temperature (3 = T~^. 

The couplings Jij also evolve in a stochastic manner, in response to the states of 
the spins, but adiabatically slowly compared to the spins, such that on the time-scales 
of the couplings the spins are always in an equilibrium state described by (|l]). For the 
coupling dynamics the following Langevin equations are proposed: 

d 1 [rr 

^u^-^y = ]y (^i^i)sp - t^ijJij + Vijit)^j^ i<j = l...N (3) 

with Tij ^ 1. In the adiabatic limit Tij oo the term (o"i(Tj)sp, representing spin 
correlations associated with the coupling J^j, becomes an average over the Boltzmann 
distribution (0) of the spins, given the instantaneous couplings J. The rjijit) represent 
Gaussian white noise contributions, of zero mean and covariance {i]ij{t)Vki{t')) = 
2TijSikSji6{t — f), with associated temperature Tij = (3~j^ . Appropriate factors of 
have been introduced in order to ensure non-trivial behaviour in the limit N oo. We 
classify the spin pairs {i,j) according to the characteristic time-scale t^j and the control 
parameters (Tij,fiij) associated with their interactions Jij. In contrast to papers such 
as H, H, |10|, where Tij = r, Tij = T and fiij = /i for all (i, j), here the various 



time-scales, temperatures and decay rates are no longer assumed to be identical, but to 
come in L distinct adiabatically separated groups le (always with i < j): 

h = {i.h3)\ Tij = n, Tij = Ti, fiij = Hi}, / = 1, ■ ■ ■ , L, (4) 

with 1 <^ Ti <^ T2 <^ . . . <^ tl. Thus {{i,j)} = {Jkl^- We will write the set of 
spin-interactions with time-scale Te as = {Jij\ G le}. The interactions in group 
I2 are adiabatically slow compared to those in group Ji, and so on. The rationale of 
this set-up is that, in information processing terms, this would represent a stochastic 
self-programming neural information processing system equipped with a program which 
consists of a hierarchy of increasingly less volatile and less easily modifiable sub-routines. 

Finally we have to define the detailed partitioning of the ^N{N — 1) interactions 
into the L volatility groups. We introduce eij{i) G {0, 1} such that ejj(£) = 1 if and only 
if G le, so Yl,^=i^ij{^) = 1 for all {i,j). In order to arrive at a solvable mean-field 
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problem, with full equivalence of the N sites, we will choose the eij{t) independently at 
random for each pair (^, j) with i < j, with probabilities 

L 

Prob[e,,(£) = l]=e, Ee^ = l (5) 

e=i 

These time-scale and temperature allocation variables thus introduce quenched 

disorder into our problem. Averaging over this disorder will be denoted by as usual. 

3. Replica Analysis of the Stationary State 

3.1. Equilibrium Statistical Mechanics of the Couplings 

We denote averages over the probability distribution of the couplings at level i in the 
hierarchy (for which Tij = Te, Tij = Ti and = fie) as (. . .)^. At every level i, the 
stochastic equation for those couplings which evolve on that particular time-scale ti 
has now become conservative: 

= - —J-He(J',...,J'') + riiJt).f^ (6) 

with the following effective Hamiltionian for the couplings at level £: 

H,{J\..., J^) = -(3-' log Z[J\ . . . , J^] (7) 

H,^,{j'+\ . . . , J^) = log Z,[j'+\ . . . , J^] (1 < £ < L) (8) 

and with the partition functions 

Z[j\...,J^] = 5:e-^^('^"^) (9) 

J^] = y'c/J^ e-^^^^^-^'--"^^) (1<^<L) (10) 

Zl = JdJ^ e-^^^^^-^'^^ (11) 

in which 

H{a, J) = - E + (12) 

i<j i<j 

This describes a hierarchy of nested equilibrations. At each time-scale the interactions 
equilibrate to a Boltzmann distribution, with an effective Hamiltonian He which 
is the free energy of the previous (faster) level £ + 1 in the hierarchy, starting from 
the overall Hamiltonian ([T^) (for spins and couplings) at the fastest (spin) level. As 
a result of having different effective temperatures Te associated with each level, the 
partition functions of subsequent levels are found to generate replica theories with replica 
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dimensions > which represent the ratios of the effective temperatures of the two 
levels involved. This follows from substitution of (§) into (p^: 



mi = pi/p 



(13) 
(14) 



The statics of the system, including the effect of the quenched disorder, are governed by 
the disorder-averaged free energy associated with the partition function in (p!T|), 
where the slowest variables have finally been integrated out: 



J^=~— log Zl = - lim — 

PL rriL+l^O niL+lPL 



log^L 



•niL+i 



(15) 



This function is found to act as the general generator of equilibrium values for 
observables at any level in the hierarchy, since upon adding suitable generating terms 
to the Hamiltonian (|T^), i.e. H{<t, J) — » H{(t, J) + A<l'(cr, J), one finds: 



d 



(...((<l>(a,J)Ui...)i=lim— ^ 



(16) 



We can now combine our previous results and write down an explicit expression for JF, 



involving multiple replications due to (|T3|,[T5|). We find JF = limm^+i^o F[mi, . . . , mL+i] 
with F[mi, . . . ,mL+i] = —{mL+iPL)~^ ^og Z]^^~^^ , and where is written as 



/7"iZ,+l 



E 

CKi ,. .. ,a.i 



+ 1} 



/3H(cr-i---L+i,j''"2--"^+\...,J^'"^+i) 



X n e 
E n n n 

{Cr"l"--'"i+i} ^=1 (i<j)e/f Q£+iv,aL+l 



E ' 



;i7) 



(modulo irrelevant constants), in which always ae = 1, . . . , m£. 
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3.2. Disorder Averaging 

In order to average (0) over the disorder, we note that the spin summation in the 
exponent can also be written in terms of the allocation variables eij{£): 

E — ^ — E E •■■ = 



i<jl<Ll^f- 



EE^^ E [E 



where we used mi... mi = (3i/(3. This allows us to carry out the average over the 
(independent) eij{t) in (0): 

n--]=--^iog E 



X n 



2N /—il<L l3iiJ.( Z-ic,i^i,...,aj^^i'-Z-ic,i 



1 



log E 



X n 

Kj 



i + |^E|^ E [E-r-'^- 

1 



friL+ipL 



log E 



e 



{cr"i'""°i+i} 



I 

X exp < —— 2^ 1^1^ -T— (^{a,+i,...,ai+i),(/3^+l,-,/3L+l) 

[ ^ aiv,aL+i /3i,...,/3i,+i /^^/^^ 

X [^E^r'-'^^vf"-''^"?} 

(again modulo irrelevant constants). We abbreviate a = (ai, . . . , ai+i), and introduce 
the spin-glass rephca order parameters Qab = '"^^^(^f^' '^^^^ by inserting 

appropriate integrals over ^-distributions, and arrive at 

F[. ..] = log (18) 



G[{qab, Qab}] = i E ^'^bQab + ^ E 13 E 

ab 4 ^<j^P£/if „b 

+ log ^ e~*^°'''^"'''^"i'--'°^+i'^''i-'''i+i (19) 

For oo the above integral can be evaluated by steepest descent, and upon 

elimination of the conjugate order parameters {qab} by variation of {qab}, the disorder- 
averaged free energy per spin / = limAr_^oo J^/N is found to be 

f = n,}^^-.0^ 1 tE ^E^("^+iv..,"L+i),{/3.+ i,...,/3L+i)9a6 
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— log ^ Q^^l<L-^^J2ab^('^i+l.---.'^L+l).(Pl+l.---.PL+l)1'^'>cr'''^>' I (^20) 
Wa} J 

The saddle-point equations from which to solve the {qab} are given by 

Qcd = ^""^ ' (21) 

with our short-hand a = {ai, . . . , ctL+i), and with G {1, . . . , m^} for all i, where the 
dimensions are given by the ratios of the temperatures of subsequent programming 
levels in the hierarchy according to (0). 

4. Replica Symmetric Solutions 

4.1. Evaluation of the Replica- Symmetric Free Energy 

Our full order parameters are qab = j^Y.i(^T'"''^^^^^i^'"''^^^^- Note that a^+i = 
Spin variables with ai = have identical level-L bonds. Those with = Pl and 
q;l_i = have identical level L bonds and identical level L — 1 bonds, and so on. 
Hence, for the present model the replica-symmetric (RS) ansatz (describing ergodicity 
at each level of the hierarchy of time-scales) takes the following form: 

o:l7^Pl- qab = qL, 

{at+i, . . . ,aL+i) = {Pi+i, . . . , aiy^Pi'. qab = qi, 

a = b : gab = 1 



or 



L 

Qab = 51 * '^{«f+i,.-,"z,+l){/3^+i,-,/3L+i)^a^A + ^ab (22) 

where 6ij = 1 — 6ij, and where 

< gL < • • • < gi < 1 (23) 
With a modest amount of foresight we introduce the abbreviation 

-e = tP^ = t—^- (24) 

P£'At£' ^i^iTTii ■ ■ ■ Trie' t^t 

Insertion of the ansatz (^2]) into (^) gives (using the relation /3i = PYl^^i rni, and with 
the notational convention qi+i = to simplify summations): 

" 1^1 + ™ J^"^n ^ T 1 I ^ WTT ^ £ Qe'S{a,,+„...,aL+i),{Pt,+„...,l3L+i)'^a,,0,, 

— log ^ S«<L Y,ab J2e'=e '?f'^(«f/+i,--.,aL+l).(/3^/ + i,---,/3i+i)^<^f/,/3f/°""'^'' 

1 1 1 
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lim — log < 



X e 



11 1 1 

7^1 + 7 l^^l^^"^! • ■ ■m(,-i{vfi(-i) + -gi7ri(mi-l) + -qii^i 

^ ^ (.=2 ^ ^ 



— lim 



1 



I L 11 
r^i + 7 X!?!^^"^! • ■ ■ mi-i{mt-l) + -gi7ri(mi-l) + -giTTi 



lim 



log 



n n ^^Q;<!+i...ai,+i 
£=1 a^+i-.-Qi+i 



X 



n 



2 cosh[^ Za,+,...aL+,^ Piqe-Ke - Qe+m+i)] 



e=i 



Alternatively, we can reduce the number of Gaussian integrations in this expression to 
a smaller number of nested ones: 

111^ 1 1 

/ = - -ttl - -log2 + -^qjiTtmi ■ • •m£_i(mr-l) + -gi7ri(mi-l) + -giTTi 



1=2 



— lim 



log 



Zi\l l3{qi'Kr-q2T^2)+ \/ P{qeT^r-qe+m+i) 



1=2 



111 1 1 

= - ^ttl - - log 2 + - ^ gfTT^mi • • • m£_i(mr-l) + -gi7ri(mi-l) + -^itti 



^=2 



m2 ^ ™i 



75 ^ log l^^L 

, . jy^D^i cosh™i J2ze^p{qe7ri - qe+m+i) | 

For L = 1 this reduces to (modulo the irrelevant constant): 

/ = ^qiT^i + ^gi7ri(mi-l) - log 2 - ^^log J Dzi cosiT' zi^JJq^i 



(25) 



whereas for L > 1 we can simplify our result to (modulo the irrelevant constant): 



1 1 1 

/ = ifiqi - ^ log 2 + - 5^ qji^i 



i=2 



n "^fc 



{ma - 1) + -gi7ri(mi-l) 
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cosh 



L-l 



(26) 



For systems with a single coupling time-scale (P3|) we again observe the similarity with 



the free energy of Parisi's RSB-1 ansatz |13| (see also e.g. g |TT1). For systems with 



multiple coupling time-scales ( P6|) this similarity is lost: Parisi's RSB-L solution [T^, 111 



emerges only when tti = til for all i, i.e. when we return to a single coupling time-scale. 



4-2. The Single-Level Benchmark 

A simple and convenient benchmark test of the above equations is obtained upon putting 
ee Sri for some r G {1, . . . , L}. Here we retain only a single bond time-scale, and our 
theory should effectively reduce to that of 0. For L = 1 this is indeed true, according 
to equation (p5D; here we will address the generic case L > 1 and 1 < r < L. The 
occur only in the quantities tti of ([2^), which now simplify to 

7r^<r = T^e>r = (27) 

/i^mi ■ ■ ■ nir 

Insertion into the replica-symmetric disorder-averaged free energy per spin (^6]) gives 



1 1 1 

/ = T^^rQl - - log 2 + -Hr J2 (ll 



n "^fc 



.k=\ 



{me - 1) + -ql7ir{mi-l] 



X < cosh 



r-l 



Zr^l3qrTCr + Ze^ f3{qe - qe+i)TT' 



mi m,2 m,.-i \ rrir 



Since qi measures the overlap between spin states with different level L bonds, g^.i 
measures the overlap between spin states with identical level L bonds but different level 
(L — 1) bonds, and so on, the relevant state for ee = 6re must be one where qe = qr for 
all £ < r. Insertion into the above expression gives 

11 1 

/ = -T^r-qr - ^log2+ ^Vr^g^dl " 1) 



1 



P IYe=i 



k=l 

log / Dzr \ cosh 



Zr\f^q^r 



.-| 'I m\m2---mr 



This expression is indeed equivalent to (^), from which it can be obtained by making 
the replacements vri vr^ and mi mi ■ ■ ■ mr- 



4.3. Nature of the Physical Saddle-Point 

Due to our previous elimination of (imaginary) conjugate order parameters and the 
possible curvature sign changes occurring in replica theories, we can no longer be sure 
that the relevant saddle-point (p5|,|26|) gives the minimum of /. In order to allow us 



to select the physical saddle-point in situations where multiple saddle-points exist, we 
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now first determine the nature of tlie pliysical saddle-point by inspection of the high- 
temperature state. Since there are multiple temperatures in this problem (one for the 
spins, and L for the various bond levels), there are also different ways to send all 
temperatures to infinity, with potentially different outcomes. Here we consider the limit 
which appears most natural, where /5 ^ for fixed {mi, . . . , m^}. We then obtain from 
expression (PUf), with / = / + ^ log 2: 



lini/ = 77^191 + 7 E?^^ 



1=2 



7-1 



n 



k=\ 



{me - 1) + ^gi7ri(mi-l) 



/mfb^ '""/"'^ { ■ + 



X Jdzi 



L-l 



1 2 



1 



m2 



1 1 



n "^fc 



LA;=1 



m,-l) + ^g2^i(mi-l) + 0(/32) 



lim J — , - , 



log i+o/3[n^^] 



L-l 



7E^£^^ 



£=2 



■£-1 

n 

.k=l 



(m, - 1) + -giV(mi-l) + 0(/3') 



(28) 



This shows explicitly that the nature of the physical state, for (3^0 given by = 
for all i, depends on the specific choice made for the various coupling temperatures, 
which determine the replica dimensions {m^} via (0). This is in sharp contrast with 
the standard Parisi ansatz [|13] where one always has me < 1. Here we find: 

me > 1 : minimisation of / with respect to qe 
me < 1 : maximisation of / with respect to qe 



(29) 



4-. 4- The Full Saddle-Point Equations 

In this section we derive the full saddle point equations of ( ^6]) for the replica-symmetric 
order parameters < g^, < qL-i < ■ ■ ■Q'l < 1, in the general L-level hierarchy. This is 
most efficiently done by first writing the free energy (EO) as 



/ 



1 1 1 

-TTigi - -log2 + 



e=2 



n 



.k=l 



{me - 1) + ^gi7ri(mi-l) 



K 



-IP time]-' log K 

e=i 

jDzLy Dzl-1 { • • • {/^^i {cosh S}' 



m2 rriL-i >, rriL 



L-l 



Zl\J (iqiT^L + Y ze\j (3{qe'Kir-qi+iT^i+i) = J2"'i^i^ 



i=i 



ae{<L) 



(3{qenr-qe+iTTe+i), cll = -J PqiT^L 



(30) 

(31) 
(32) 
(33) 
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From this it follows, upon taking derivatives of / with respect to qi and g^>i, respectively, 
that the saddle-point equations can be written as 

11,, I I dK 

2 2 jJmi- ■ ■ nil K oqi 

1 11 dK 

= -qeMUm,]im,-l) - for i > 1- (35) 

The remaining problem is to calculate the various derivatives of K, which is complicated 
by the nesting of integrals. Note that K can be written as i^' = K^, where is defined 
iteratively: 

Ko = cosh S, Kl = I DzlK^i (36) 
To suppress notation we also define 

i 

Mo = 1, M,>o = n ^^'^ if)i = ^i' Dze K-J{z,) (37) 
i'=i •' 

In [Appendix lj| we show that, with these short-hands, the relevant derivatives of K are 



given by the following expressions: 



IPtt.MlK {1 + (mi - 1)(- ■ ■ (tanh^ E)^■■ (3^ 



dqi 2 

O TV" -1 

= -/37r,MiM,_i(m, - 1)K{- ■ ■ {[{■ ■ ■ (tanhS)i ■ • ■),_,]^), ■ ■ ■)l (39) 

Hence the saddle-point equations (|35|J35D reduce to the, in view of the definition (|22|), 
appealing and transparent relations 

gi = (...(tanh^H)!...)^ (40) 
g,>i = (...( [(...(tanhS)i...),„i]2 ),...)^ (41) 

5. The Two-Level Hierarchy: L = 2 

5.1. General Properties 

We next apply our results to the case where we have just two time-scales in the bond 
dynamics, and calculate the phase diagram. We found in studying the single level limit 
that our theory will simply self-consistently 'forget' about non-existent intermediate 
levels (as it should), and substitute the right temperature definitions in the expressions 
that would have been obtained if we had considered subsequent levels. Hence we may 
choose L = 2, without loss of generality, and simply put L = 2 in expression 



fL=2{qi,q2) = ^TTigi - -^log2 + ^g2^2"^l("^2 - 1) + ^gi7ri(mi-l) 



log / Dz2 I / Dzi {cosh 

-imo Jul 



(3mim2 



Z2Jf3q2r(2 + ziJ I3{qini-q2n2 



(42) 
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For L = 2 the saddle-point equations reduce in explicit form to 

JDz2[JDzi cosh^^S]' 



(l2 



J Dzi cosh"*! Stanh^ 
JDzi cosh"! H 



JDz2[JDzi cosh™^S]™2 
JDz2[JDzi cosh'"^ 



J Dzi cosh™i HtanhS 
jDzi cosh™! S 



JDz2[JDzi cosh^^S; 



m2 



(43) 



(44) 



(note: qi > ^2), with 



S = Z2\l(3q2'T^2 + zi\l(3{qi'ni - q2'n2) 

We can distinguish between three phases. The first is a paramagnetic phase (P), 
corresponding to the solution gi = g2 = of (^,^^; according to ( pSj) it is the sole 
saddle-point of ( ^2]) in the high temperature regime, as it should. The second is a spin- 
glass phase [SGij, corresponding to a solution of the form qi > 0, q2 = 0, describing a 
(spin-glass type) state with freezing of spins and couplings at time-scale ti but not on 
the time-scale r2 ^ ri. Spins and level-1 couplings 'freeze' into a state determined by 
the level-2 couplings, but the latter slowly but continually evolve, given sufficient time. 
Insertion of ^2 = into ( |45|P^ shows that in this SGi phase qi is the solution of 

jDz cosh"'^ {zy/ jSqiTii) taii\i^{zy/ jSqiiXi) 

jDz cosh'^^z^^^i) ^ ' 

In the third phase {SG2) one has gi 7^ and q2 7^ 0, and the system freezes on all 
time-scales. Now one has to solve ( ^^4[) in full. We indicate the various potential 
transition temperatures separating these phases as follows: 



T-i2nd 

rp2l\d 

1,2 

rrnlst 

ry-ilst . 
J-p,2 ■ 



P SGi 
SG\ — > SG2 
P SGi 
P^ SG2 



2nd order 
2nd order 
1st order 
1st order 



(46) 



We will find that this list contains all transitions occurring. 



5.2. P ^ SGi Transitions 

The locations and properties of the two types of P — >^ SGi transitions follow upon 
expanding /(gi, 0) in powers of qi. 

-f3mif{qu 0) = Po + a{T)ql + b{T)ql + c{T)qt + ■■■ 

The coefficients are found to be 

a(T) = -mi(mi — l)/37ri(/?7ri — 1) 

b{T) = Im.imi - l)(mi - 2){P7r^f 
o 

c(T) = -^mi(/57ri)^(3m? - 72ml + 128mi - 68). (47) 
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Note that c(T) < for < nii < m+, where m_|_ ^ 15. A continuous bifurcation occurs 
when a{T) = 0, i.e. when T = tti, so 

= ^i/ "^1/^1 + ^2/ mim2fJ.2 (48) 
This bifurcation can, however, dependent on the values of {mi, 7712}, be preceded by a 
discontinuous one. Upon varying mi one finds the following scenario: 

< mi < 1: b{T) > 0, f{qi, 0) maximal at gi = for T > T^f 

f{qi, 0) maximal at gi > for T < T^f 

1 < mi < 2: 6(T) < 0, f{qi, 0) minimal at gi = for T > 



2nd 



/(gi, 0) minimal at gi > for T < T^^^ 

2 < mi: b{T) > 0, /(gi, 0) minimal at gi = for T > T^f 

/(gi, 0) minimal at gi > for T < T^f 



where T^^f signals a discontinuous (i.e. first order) transition, with T^^^ > T^^'^. The 
condition for this latter transition follows from putting the derivative of the right-hand 
side of (|45|) with respect to gi equal to unity, giving 



2^ 



mi(l — mi)g;^ + 4(mi — 2)gi + 2 



+ (mi -2) (mi -3) 



JDz cosh™^ (zy/pq^) tanh\z^pq^) 



(49) 



JDz coslT'iz^/^^) 
Together with (|29| ) we may now conclude that the P SGi transition is second order 



for mi < 2, in which case it is given by (|48|), and first order for mi > 2, in which case it 
is given by the solution of (|49|). In a subsequent section we will show that for mi — > 00 
the first order transition temperature T^f tends to a finite and nonzero value. 

5.3. Transitions to SG2 

There are found to be two such transition temperatures: T^^f (where one goes from a 
paramagnetic state to one with gi > g2 > 0) and T^2'^ (where one goes from gi > g2 = 
to gi > g2 > 0). The transition condition defining T^2'^ follows from putting the 
derivative of the right-hand side of (P^ with respect to g2 equal to unity, followed by 



putting g2 = 0, which gives 



/?7r2[l + (mi-l)gi] (50) 



We will show in [Appendix A| that 2 oc JT /mi = \JT{ as mi — > 00 



To determine T^^f , in contrast, one must demand an instability of (43 j4^) with 
gi^2 > 0. This implies meeting the more general condition 

dkpi ..,dip2 ^^ dipidip2 , . 



where (/5i(gi, g2) and 922 (gi, g2) denote the right-hand sides of (|43| ) and (|J), respectively. 



For mi 00 we will show, as with T^f , that also T^^f tends to a finite and nonzero 
value, and that T^ g^*'* > T^^i \ Hence, T^f will ultimately become the true physical 
transition as mi —> 00 (or, equivalently, Ti ^ for fixed T). 
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5.4- The L = 2 Phase Diagram 

For L = 2 there are still five independent control parameters in our model, viz. T, mi, 
7712, VTi and 712 (where 7^2 = e2/'mim2^2 and vri = 7r2 + ei/mi/ii) or any combination of 
these. Hence we can only present representative cross-sections of the full phase diagram. 
In this section we will restrict ourselves to showing the transition lines in the (Ti,T) 
plane, solved numerically from the various appropriate conditions as derived above, for 
the choice ei//ii = 1, €2/ fi2 = 2 with m2 G {0.5, 1.5} (which was found to cover more or 
less the generic scenarios). According to (|48|) , for this choice of parameters the second 
order P SGi transition temperature T^'^'^ will be at 

T^f = —(1 + — ) (52) 
^' mi m2 

and it is replaced by a first order P SGi transition at mi = 2, which, together with 
the relation mi = T/Ti, tells us that the first and second order P SGi lines meet at 

TiS = T;t: T, = hl + —) (53) 
^' ^' 4 m2 

In section 1^ we will prove that, for any L, the discontinuous transition temperatures T^f 
and Tpl* always tend to a finite non-zero value as mi 00, whereas limmi^oo i'^ = 
lim^^^oo 2*^ = 0. Thus, for sufficiently small Ti (i.e. large mi) the first order 
transitions are always the ones which will actually take place. Secondly, we will find 
that there is always a critical value TjP^ for Ti such that Tf'^ = at Ti = TjP\ with 
Tl'f simply absent for Ti > r]°); as a consequence, the phase SG2 no longer exists 
for Ti > T^^\ These two properties will be shown to be specific cases of more general 
results concerning spin-glass phases of arbitrary order. 

Let us first turn to m2 = 0.5, i.e. relatively high noise levels in the level-2 couplings 
compared to that of the spins. In figure ^ we show the phase diagram and the various 
bifurcation lines of the L = 2 system for m2 = 0.5, as obtained by numerical solution 
of the relevant equations. The actual physical transitions are the ones which occur first 
as the temperature T is lowered from within the paramagnetic region. It will be clear 
from the figure that upon lowering T one can find different types of transition sequences, 
dependent on the value of Ti, which prompts us to define the following critical values 
for Ti (these depend on the values chosen for the control parameters): 



c 


12.575 : 


creation point of phase 


SG2 


rW - 

c 


1.25 : 


creation point of f. 


T-i2nd T-ilst 


T(2) ~ 
c ^ 


1.15 : 


Tp^f and T^f touch tan 


gentially 


T(3) ~ 
c ^ 


1.06 : 


creation point of T^f , 


T-i2nd T-ilst 
1,2 ~ -'p,2 



Note: T]^) is the point given by expression (pSj). In terms of these critical values we can 
classify the different transition scenarios encountered upon reducing T down to zero, 
starting in the paramagnetic region, as follows: 

TJ°) < Ti : P ^SGi (2nd order) 
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3.5 




I 1 1 1 1 1 1 1 0.0 ' ■ 1 ■ 1 ■ 1 ■ 1 ■ 1 

2 4 6 8 10 12 14 0.0 0.4 0.8 1.2 1.6 2.0 



Figure 2. Phase diagram in the {Ti,T) plane for L = 2, ei/iii — 1, €2/1-1.2 = 2 
and 7712 = 0.5, obtained by solving numerically the equations defining the various 
bifurcation lines (note: Ti = T/mi). Left panel: the large-scale structure. Right 
panel: enlargement of the low Ti (or high 7711) region, where the first order transitions 
are found. The relevant phases are P (paramagnetic phase, qi = (72 = 0), SGi (first 
spin-glass phase, qi > 0, 52 = 0), and SG2 (second spin-glass phase, qi > 0, q2 > 0). 
The transition lines shown, as defined in (^), are T^f^ (solid curve), Ti^'^ (dot-dash 
curve), Tp^i (dashed curve), and 2* (dotted curve). Note: the curve 2^^ jumps to 
zero discontinuously at Ti — Tc^^ w 12.575 (see main text). 



TJ^) < Ti < TJ^) 
Tf ) < Ti < tJ^) 
Ti < T/3) : 



SG2 (2nd order) 
(2nd order) 
5^2 (2nd order) 
SG2 (1st order) 



P SGi (2nd order), Sd 

P SGi (1st order), SGi 

P SGi (1st order), SGi 

P SGi (1st order), SGi 

In figure ^ we show the corresponding values of the order parameters along the various 
transition hues, as functions of Ti (with hne types identical to those used in figure |^ for 
the same transitions), except for those order parameters which are zero by definition 
(such as the values of q2 when bifurcating continuously from zero). Curves in figures ^ 
and 1^ which terminate for small but nonzero values of Ti do so due to computational 
limitations; they can be shown to extend down to Ti = 0. We will calculate the values 
of the order parameters in the nii — > 00 (i.e. Ti 0) limit analytically in a subsequent 
section. 

The general tendency in the phase diagram, as expected, is for the system to have 
more phases, increasingly discontinuous transitions separating them, and hence the most 
interesting physics, for small values of Ti (i.e. large nii). We should emphasize once 
more in this context that in our model we have the freedom to choose mi > 1 (or 
Ti < T), in contrast to the standard Parisi solution for ordinary complex systems 
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Figure 3. Values of the order parameters qi and q2 as functions of Ti, along some 
of the transition lines of the previous figure, for L = 2, ei/fii = 1, £2/^2 = 2 and 
m2 = 0.5. The values shown are qi along T^'2'^ (dot-dash curve), qi along (dashed 
curve), and both qi and q2 for 2* (dotted curves). Note: the order parameters which 
are not shown in this figure are zero by definition. 



(where one always has mi < 1). 

Let us next turn to m2 = 1.5, i.e. relatively low noise levels in the level-2 couplings 
compared to that of the spins. In figure ^ we show the phase diagram and the various 
bifurcation lines of the L = 2 system for m2 = 1.5, as obtained by numerical solution 
of the relevant equations. It is again clear from the figure that upon lowering T one 
can find different types of transition sequences, dependent on the value of Ti. Now the 
relevant critical values for Ti follows: 

T^^^ ^2.17 : creation point of phase 5*^2 

creation point of Tp2*, T^^ 



c 

rp{2) 

c 

7^(3) 



2.17 
0.597 
7/12 ^ 0.583 
0.5572 



i2nd 
,2 



ry-ilst 

P,2 



T-i2nd 

T-llst 



T-llst 
T-llst 

^P,2 



Note: Tjf> is the point given by expression (^). In terms of these critical values we 
can classify the different transition scenarios encountered upon reducing T, as before, 
as follows: 



SG2 (2nd order) 
SG2 (1st order) 
SG2 (1st order) 



TJ°) < Ti : 


P - 


S Gi 


(2nd order) 




T^i) < Ti < Ti°) : 


P - 


S Gi 


(2nd order). 


SG 


TJ^) < Ti < TJ^) : 


P - 


S Gi 


(2nd order). 


SG 


rf ) < Ti < TJ^) : 


P - 


SGi 


(1st order). 


SG 


Ti < ) : 


P - 


SG2 


(1st order) 
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Figure 4. Phase diagram in tlic {Ti,T) plane for L = 2, ei//ii, £2/^2 — 2 
and 7712 = 1-5, obtained by solving numerically the equations defining the various 
bifurcation lines (note: Ti = T/mi). Left panel: the large-scale structure. Right 
panel: enlargement of the low Ti (or high mi) region, where the first order transitions 
are found. The relevant phases are P (paramagnetic phase, qi = (72 = 0), SGi (first 
spin-glass phase, qi > 0, 52 = 0), and SG2 (second spin-glass phase, qi > 0, (72 > 0). 
The transition lines shown, as defined in (^), are T^f^ (solid curve), Ti^'^ (dot-dash 
curve), Tp^i (dashed curve), and 2* (dotted curve). Note: the curve 2^^ jumps to 
zero discontinuously at Ti — Tc^^ w 2.17 (see main text). 



In figure ^ we show the corresponding values of the order parameters along the various 
transition lines, as functions of Ti (with line types identical to those used in figure || 
for the same transitions), except for those which are zero by definition. Again, curves 
in figures ^ and ^ which terminate for small but nonzero values of Ti do so due to 
computational limitations. The values of the order parameters in the mi 00 (i.e. 
Ti — i> 0) limit will be calculated analytically in a subsequent section. 

The main difference between 1712 = 1.5 and m2 = 0.5 is that in the former case, 
for sufficiently low Ti, when lowering T the system goes straight from the paramagnetic 
state = ^2 = into the SG2 state gi 2 7^ 0, without an intermediate SGi phase. 
This is in agreement with the physical picture sketched so far: high values of the replica 
dimension m2, corresponding to low coupling temperatures (here T2), are found to induce 
more pronounced discontinuities, similar to the effect of choosing large values for mi. 

6. The Three-Level Hierarchy: L = 3 
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Figure 5. Values of the order parameters qi and q2 as functions of Ti, along some 
of the transition lines of the previous figure, for L = 2, ei/fii = 1, £2/^2 = 2 and 
1712 = 1-5. The values shown are qi along T^'2'^ (dot-dash curve), qi along (dashed 
curve), and both qi and (72 for Tp_2* (dotted curves). Note: the order parameters which 
are not shown in this figure are zero by definition. 



6.1. General Properties 

We now apply our results to the case L = 3, where we have three time-scales in the 



bond dynamics. Putting L = 3 in expression (p6D for the free energy per spin gives: 

1 1,^1 



/L=3(gi,g2,g3) 



2^151 - ^log2 + ^gi7ri(mi-l) 



+ -q27r2mi{m2 



1) + ^'?3^3"^im2(m3 - 1) 



log /^^3 {/ Dz2 [jDz^[ cosh[S] 



mi 'I m2 'I m3 



(54) 



with 



Due to the increased complexity of formulae induced by the nesting of integrals, it is 
for L = 3 no longer helpful to write the saddle-point equations for the three order 
parameters gi > ^2 > qs in explicit form. However, in order to suppress notation in 
deriving the conditions for the various phase transitions, we will introduce the following 
abbreviations for the right-hand sides of the saddle-point equations (^ , |4l|) : 

qi = (((tanh^ 2)1)2)3 = ^i{qi, ^2, qa) 



(I2 
(l3 



(({(tanhS)i}^)2)3 
({((tanhS)i)2}^)3 



ip2{qi,q2,q3) 

^3{qi,qi,q3) 
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For L = 3 we can distinguish between four phases. The first is a paramagnetic phase 
P, where qi = q-2 = q^, = 0; this always solves POU^ ), and according to (p8|), is the 
sole saddle-point of (0) in the high temperature regime. In addition we now have three 
spin-glass phases: SGi, corresponding to a solution of the form Q'l > (3'2 = 93 = (i.e. 
freezing of spins and couplings on time-scale ri but not on the time-scale T2 ^ ti), SG2, 
corresponding to a solution > ^2 > Q'3 = (i.e. freezing of spins and couplings on 
time-scales ti and T2 but not on the time-scale ^ r2), and SG^, corresponding to 
a solution gi > g2 > Q'3 > (i.e. freezing of spins and couplings on all time-scales). 
It immediately follows from the simple relation /L=3(q'i, ^'2, 0) = /l=2(q'i, ^72) that the 
phases SGi and SG2 are fully identical to those of the L = 2 model, including the 
values of the order parameters and the locations of transition lines. However, there will 
now be new transition lines which are related to transitions into phase SG3. 

All partial derivatives of the type dipi/dqe' which occur in the transition conditions 
discussed below are calculated in detail in [Appendix In the various derivations we 
will save ink and paper by using the short-hands ipi = {. . . (tanhS)i . . .)£, e.g. 

ipi = (tanhS)i, 1^2 = ((tanhS)i)2, etc. 



The result is 



mi(m2 - 1) |-mim2m3V9iV92 + mi(m2 - 2) ((V'?(tanh^ 2)1)2)3 



dcpi _ I3tt2_ 
dq2 ~ 2 

+mim2(m3 - l)(((tanh^ E:)i)2(^/'i)2)3 

+2(mi - 2)((^i(tanh3 2)1)2)3 + 4^2} (55) 

= ^("^1 " 1) {-mim2ms<^i<^2 + mi(m2 - 2) {{tpKianh^ 2)1)2)3 
+mim2(m3 - l)(((tanh^ 2)1)2(^/^1)2)3 

+2(mi - 2) ((^i(tanh3 2)1)2)3 + 4^2} (56) 

dip jSjc 

= ^ {-(mi-l)mim2m3(v9i)^ + mi(mi-l)(m2^1)(((tanh^ 2)1)2)3 
+ (mi - I)mim2(m3 - l)(((tanh^ 2)1)^)3 

+ (mi - 2)(mi - 3)(((tanh^ 2)1)2)3 + 4(mi - 2)ip, + 2} (57) 

= ^ |-mim2m3(m2 - l)(v52)^ + mi(m2 - 2)(m2 - 3)((V'i)2)3 
+ mlm2{m2 - l)(m3 - 

+ 4mi(m2 - 2)^2 + 4mi(mi - l)(m2 - 2)((?/;^(tanh2 2)1)2)3 

+2 + 4(mi - 1)^1 + 2(mi - l)2(((tanh2 2)^)2)3} (58) 

^ = ^(mi - 1) {2mi(m2 - l)(^2((tanh2 2)1^1)2)3 
+ (m3 - 2)mim2(((tanh^ 2)1)2^^2)3 

+2{mi - 2)(^2((tanh^ 2)1)2)3 + 4v53 - mim2m3V9iV93} (59) 
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-{1712 - 1) \m\m2{m:i - 2) {{ipl) 2ip' 



2/3 



dq2 2 

+ 4mi(mi - l)(^2(V^i(tanh2 2)1)2)3 

+2ml{m2 - 2)(^2(^?)2)3 + 4miV93 - mlm2ms(p2^3} (60) 



|2 - (ma - l)mim2m3V?3 + m\m\{m3 - 2) (7713 - 



dips _ /^TTs 

dqs ~ 2 

+4(m3 - 2)mim2(p3 + 4(mi - + 4mi(m2 - l)v?2 
+4(mi - l)(m3 - 2)mim2(((tanh2S)i)2^/'2)3 



+4mjm2(m2 - l)(m3 - 2) {{iPD 21P2) 



3 

+4mi(mi - l)(m2 - l)(((tanh2 2)1)2(^12)2)3 
+2(mi-l)2(((tanh2 2)1)^)3 + 2m?(m2-l)2((V^?)^)3} (61) 

-Q^ = —mim2{m3 - 1) {4v93 - mim2m3(^iV93 

+2mi(m^l)('(/'2((tanh2 5)1^1)2)3 + 2(mi-2)(^/'2((tanh=^ 5)1)2)3 
+ (m3 - 2)mim2(((tanh2 S)i)2^2')3} (62) 



^ ^ no „ ^ (m , T ^ J /I no _ / ^ n^ ^ 

dqs 2 



m2{m3 - 1) {4miV93 - mlm2m3ip2ip3 

+ 2m\ (m2 - 2) (^2 (^?)2)3 + 4mi (mi - 1) (V^2 (^1 (tanh' 2)1)2)3 
+m2(m3-2)m2((V^?)2^2')3} (63) 



6.2. Transitions Identical to Those of L = 2 

All transitions relating only to the three phases P, SGi and 5*^2, as well as the second 
order transition SGi SG2, where ^3 = 0, must be identical to those derived in the 
previous section for L = 2. The general condition for such transitions is 

= - l)(^ - 1) - §^§^ (64) 

oqi oq2 oq2 oqi 



This involves only the partial derivatives ( p5tp6| , p7tp8D . Due to ^3 = the averages 
(. . .)3 drop out, and together with the identities 

((tanh2H)i)2 = gi, ( (tanh 2)^)2 = ^2, (V'i')2 = ^2, ^^2 = (65) 

the four relevant partial derivatives simplify considerably to 

dip iStt 

= ^mi(m2 - 1) {(4 - mim2gi)g2 + mi(m2 - 2)(?/'i(tanh2 2)1)2 
+2(mi-2)(^i(tanh=' 5)1)2} (66) 



mi - 



d(p2 _ /^TTi 

dqi ~ 2 

+2(mi-2)(^i(tanh=' 2)1)2} (67) 



1) |(4 - mim2qi)q2 + mi(m2 - 2) (?/'i (tanh^ 2)1)2 
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dipi P^^l ( / \ 2 / \/ \//i2\2\ 

= l2 - [mi - l)mim2qi + mi(mi-l)(m2-l)((tanh ^)i)2 
oqi 2 

+ (mi -2)(mi -3)((tanh^S)i)2 + 4(mi -2)gi} (68) 



dip2 _ P712 / ^2 



^-mlm2ms{m2 - l)ql + 'm\{m2 - 2)(m2 - 3)(-?/'i)5 



+ m\m2{m2 - l)(m3 - 1){'4'IY 



2 



+ 4mi(m2 - 2)g2 + 4mi(mi - l)(m2 - 2)('?/'^ (tanh 2)1)2 
+2 + 4(mi - + 2(mi - l)2((tanh2 2)2)2} (69) 

For the P SGi transitions and the continuous SGi SG2 transition we have 
to put q2 = 0, in (^,0,^,^). We then arrive, together with the dropping out 
of (. . .)2 and the relations ipi = ^2 = 0, (tanh^H)! = gi, at the simple expressions 

dipi/dq2 = dip2/dqi = and 

dipi _ |2 _ ^^(^^_i)g2 ^ (m^_2)(mi-3)(tanh^S)i + 4(mi-2)gi} 



dqi 

/37r2[l + (mi-l)gi] 



^"^^ - n \^ , t 1^ 12 



dq2 

Thus (0) gives us the transition conditions 

^ {2 - mi{mi-l)ql + (mi-2)(mi-3)(tanh'* S)i + 4(mi-2)gi} = 1 (70) 

/37r2[l + (mi-l)gi]2 = l (71) 

For qi = (where also S = 0) we recover from (^0]) the condition (|48|) for the line T^^'^, 
for gi > equation (^) is seen to be identical to condition T = tti (which for L = 2 led 
to (ID) for the line T^^f , and (^ is identical to condition for the line Tf^'^. Finally, 
the condition for the first order SGi SG2 transition line T^f of L = 2 is recovered 
by combining the full expressions ( |66| , |67| , |68| , |69D with the bifurcation condition (p^), as 



it should. Thus, from our L = 3 saddle-point equations we do indeed extract fully those 
transitions encountered earlier for L = 2, which do not involve the 5*6*3 phase. 

6.3. Transitions to SG3 

The novel transitions induced by going from L = 2 to L = 3 are those where the new 
phase SGs is concerned. The condition for second order SG2 — ^ SG^ transitions is 
simply given by dip^/dq^lg^^o = 1. Inserting qs = into (0), followed by usage of the 
simplifying relations ( |65D which follow from q^ = 0, leads to 

-^1,3=0 = /37r3[l + (mi - l)qi + mi{m2 - 1)52]^ 

And the condition defining the critical temperature Tg^s'^ for the second order transition 
SG2 SG3 is seen to be simply 

(37i3[l + (mi - l)gi + mi(m2 - 1)^2]' = 1 (72) 
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Finally, the most general bifurcation condition defining first order SG2 — > SG^ 
transitions is given by 

d(pi/dqi - 1 d(pi/dq2 dcpi/dq^ 

9^2/ dqi d^2/dq2-l dip2/dq3 

dfs/dqi dip3/dq2 dips/dq-^-l 

where g'l > ^'2 > Q'3 > 0. Here there are no further simplifying properties to be exploited, 
and hence (^3]) must be solved numerically with the full expressions (^6|-^) for the nine 
partial derivatives. 



(73) 



6.4- The L = 3 Phase Diagram 

For L = 3 we have seven independent control parameters, viz. T, mi, m2, m^, tti, 712 
and TTs (where tts = €3/17111712171^^13, vr2 = tts + e2/mim2/i2 and tti = TC2 + ei/mi/ii), 
so we again have to resort to phase diagram cross-sections. As in the previous case 
L = 2 we will show the transition lines in the (Ti, T) plane, solved numerically from the 
various bifurcation conditions, now for the choice ei/fii = €2/112 = 1, es/A^s = 2 with 
m2 G {0.5, 1.5} and with 7/13 = 2 (i.e. relatively low noise levels in the level-3 bonds). 
According to (^81) , for this choice of parameters the second order P SGi transition 
condition T"^^ = ni will again reduce to 

T^f = —(1 + — ) (74) 
^' mi m2 

and is replaced by a first order P SGi transition at mi = 2, or 

T^l = Tlf: Ti = -{1 + —) (75) 
^' ^' 4 m2 

As in the case L = 2, we will generally find (see section |^) that for any L and for any 
i > 1 there are always non-zero critical values for Ti above which T^^^^i = 0. Hence 
all spin-glass phases SGe^i will at some finite point cease to exist as Ti is increased. 
The values of the order parameters in the mi 00 (i.e. Ti 0) limit will be also be 
calculated analytically in section 0. 

In figure ^ we show the phase diagram and the various bifurcation lines of the L = 3 
system for m2 = 0.5 (relatively high noise levels in the level-2 couplings), obtained by 
numerical solution of the relevant equations. The physical transitions are the ones which 
occur first as the temperature T is lowered from within the paramagnetic region. In the 
present case the different Ti-dependent types of transition sequences are separated by 
the following critical values for Ti. 



Tf) ^ 12.575 
= 1.25 
) ^ 1.15 
T?) ^1.06 



creation point of phase SG2 



creation point of T^'J, T;^ = 



1st r7-i2nd rplst 

Tp 1* and T^^f touch tangentially 
creation point of T^^f , T^f = T^^^ 
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3.5 




Figure 6. Phase diagram in the {Ti,T) plane for L ~ 3, ei/ni — e2//i2 = 1, 
£3/^3 = 2, ms ~ 2 and m2 = 0.5, obtained by solving numerically the equations 
defining the various bifurcation lines (note: Ti — T/rrii). Left panel: the large-scale 
structure. Right panel: enlargement of the low Ti (or high mi) region, where the 
first order transitions are found. The relevant phases are P (paramagnetic phase, 
qi = q2 — 0), SGi (first spin-glass phase, qi > q2 — qs = 0), SG2 (second spin-glass 
phase, qi > 52 > 93 = 0), and SG3 (third spin-glass phase, (71 > 92 > ?3 > 0). 
The transition lines shown are ""^ (solid curve) , 2'^ (dot-dash curve) , 2* (dashed 
curve), Tpl* (dotted curve), Tj^^'^ (short dashes), and T2^f (dot-long dash curve). Note: 
the curves T^^'^ and T^^'^ jump to zero discontinuously at Ti = Ti°^ w 12.575 and 
Ti = Tc'^^ « 0.692, respectively (see main text). 



TJ^^ ^ 0.692 : creation point of phase SG3 

) ^ 0.38 : creation point of T^^f , T|f = Tp^f 
rj^) ^ 0.325 : Tp^l = Tp^| 

Note: T^^) is the point given by expression (^). In terms of these critical values we 
can classify the different transition scenarios encountered upon reducing T down to zero 
(and the orders of the transitions), starting in the paramagnetic region, as follows: 

Ti°) < Ti : 
Ti^) < Ti < t5 
) < Ti < TJ^- 

Ti^) < Ti < : 

Ti^) < Ti < ri^- 

Ti < Ti^) : 
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Figure 7. Values of the order parameters qi and 52 as functions of Ti , along some of 
the transition lines of the previous figure, for L = 3, ei//ii = £2/(^2 = 1, ea/z^s = 2, 
ma = 2 and m2 = 0.5. The values shown are qi along ^^^2^^ (dot-dash curve), qi along 
Tp^i (dashed curve), qi and 52 along T^l* (dotted curves), qi and 52 along Tl^*^ (short 
dashes), and qi, 52 and 93 for Tj^f (dot-long dash curves) Note: the order parameters 
which are not shown in this figure are zero by definition. 

In figure |^ we show the corresponding values of the order parameters along the various 
transition lines, as functions of Ti (with line types identical to those used in figure ^ for 
the same transitions), except for those order parameters which are zero by definition 
(such as the values at the transition of order parameters which bifurcate continuously 
from zero). Curves in figures ^ and |^ which terminate for small but nonzero values of 
Ti do so due to computational limitations. 

In figure ^ we show the phase diagram and the various bifurcation lines of the L = 3 
system for m2 = 1.5 (i.e. relatively low noise levels in the level-2 couplings), as obtained 
by numerical solution of the relevant equations. Now the relevant critical values for Ti 
are as follows: 
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Figure 8. Phase diagram in the {Ti,T) plane for L ~ 3, ei/ni — £2/^2 = 1, 
£3/^3 = 2, TO3 = 2 and m2 = 1.5, obtained by solving numerically the equations 
defining the various bifurcation lines (note: Ti — T/nii). Left panel: the large-scale 
structure. Right panel: enlargement of the low Ti (or high mi) region, where the 
first order transitions are found. The relevant phases are P (paramagnetic phase, 
Qi = 12 — 0), SGi (first spin-glass phase, qi > q2 — = 0), SG2 (second spin-glass 
phase, qi > 52 > 93 = 0), and SG3 (third spin-glass phase, (71 > 92 > ?3 > 0). 
The transition lines shown are ""^ (solid curve) , T^^ 2'^ (dot-dash curve) , 1* (dashed 
curve), Tp^2 (dotted curve), Tj^g^ (short dashes), and T2^f (dot-long dash curve). Note: 
the curves Ti'^'^ and T^g"^ jump to zero discontinuously at Ti = ri*'-' « 2.17 and 
Ti = ri^-* « 1.3, respectively (see main text). 



Note: T^^^ < Tj:^\ In terms of these critical values we can classify the different transition 
scenarios encountered upon reducing T, as before, as follows: 

< Ti : 

Ti^) < Ti < Ti°) 

Ti^) < Ti < ri^) 

Ti < Ti^) : 

In figure ^ we show the corresponding values of the order parameters along the various 
transition lines, as functions of Ti (with line types identical to those used in figure ^ 
for the same transitions), except for those which are zero by definition. Again, curves 
in figures ^ and ^ which terminate for small but nonzero values of Ti do so due to 
computational limitations. 

The general picture for L = 3 is obviously more complicated but qualitatively 
similar to that which we arrived at for L = 2, with increasingly discontinuous and 
non-trivial phase behaviour of the system for decreasing relative noise levels of the 
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Figure 9. Values of the order parameters qi and 52 as functions of Ti, along some of 
the transition lines of the previous figure, for L = 3, ei//ii = £2/(^2 = 1, ea/z^s = 2, 
ma = 2 and m2 = 1.5. The values shown are qi along ^^^2^^ (dot-dash curve), qi along 
Tp^i (dashed curve), qi and 52 along T^l* (dotted curves), qi and 52 along Tl^*^ (short 
dashes), and qi, 52 and qz for Tj^f (dot-long dash curves) Note: the order parameters 
which are not shown in this figure are zero by definition. 



couplings, whether measured by mi, 777,2 or "t-s- For instance, for L = 2 we observed 
that for sufficiently large values of mi and m2, upon lowering T the system goes straight 
from the paramagnetic state gi = ^2 = into the SG2 state gi > 52 > 0, without an 
intermediate SGi phase. Here we see, similarly, that for sufficiently large values of mi, 
m2 and m2, upon lowering T the system goes straight from the paramagnetic state 
Q'l = Q'2 = 93 = into the 5* 6*3 state gi > 52 > Q'3 > 0, without intermediate SGi or SO 2 
phases. 

Finally, in the next section we will show that the jump of the SG^ SGe+i 
transitions, as observed in the L = 2 and L = 3 phase diagrams for small T, reflect 
non-physical re-entrance phenomena, which can be regarded as indicators that replica 
symmetry will be broken for values of mi = T/Ti close to zero. 

7. Asymptotic behaviour in L-level Hierarchy 



In this section we study the saddle-point equations of the general L-level hierarchy in 
the two limits Ti for flxed T (i.e. mi —>■ 00, fully deterministic evolution of level-1 
couplings) and T — for flxed Ti (i.e. mi 0, fully deterministic evolution of spins). 
For the particular choices L = 2 and L = 3 this implies solving our model along the left 
and bottom boundaries in the phase diagrams of flgures H, |, |] and ||. 
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7.1. The Limit mi — » oo m the L-level Hierarchy 

In this subsection we study the order parameter equations in the £-th spin-glass phase 
SGe,, characterized by gi > . . . > > and g^+i = . . . = gz. = 0. We calculate the 
order parameters in the limit nii oo (deterministic evolution of level-1 couplings), for 
fixed /9, and we derive in this limit an expression for the first order P —>■ SGe transition 
temperature T^ ^*. Insertion of g^+i = = . . . = = into expression (^) for the 
free energy per spin gives 

1 1 1 ^ 

/ = ^TTigi - - log 2 + - ^ ql'nkmim2 ■ ■ ■ m^-i (mfc - 1) 

^ P ^ k=2 

1 ^ 
+ -giVK-l) - [/3 n m,]-HogKe (76) 
^ k=i 



Dze^jDze-i\^... J Dz2\^jDzi {coshEr^j . . . j j 



with 



k=l 

It is not a priori obvious how the various order parameters will scale with mi for 
nil —* oo. Here we will make a scaling ansatz which we then show to lead self consistently 
to solutions of our saddle-point equations, which satisfy all physical and mathematical 
requirements. We assume that S = 0{m1) as mi — > oo, and we consequently put 

«fc = SfcCfc, Zk = ZkCk {k = 1, . . . , i) 
such that S = Y,k=i ^kC^k-, with = 0{m^ and Zk = 0{m1), and with scaling functions 
Ck = Ck{fni) which will be determined in due course. As a consequence, we can work 
out the term in ([76D for large mi as follows: 

^^1 ,{CfmilncoshH~i52)/C? I I I 



This expression immediately suggests that the appropriate mi — *• oo scaling is obtained 

— 1/2 ~ 

upon choosing C,i = mi . As a result of this choice, the zi integration can for mi — > oo 
in leading order be carried out by steepest descent, and we arrive at: 

> ms ~| m.i_i ^1 rrii 
^mim2ki(z\,Z2,---,Z() I 



K,^ jDz,^jDz,^i^...^jDz2 
ki{zi, ^2, ■ ■ ■ , zi) = In cosh S — -z^ 



2 

where 5° denotes the saddle-point of ki with respect to variation of zi, i.e. 

^\iz0,z2,-,z,) = : Zi= aitanhE{z^,Z2,--- ,Zi) 

Hence 5° is ^ function of Z2, - ■ ■ ,Zi. We now see that one can repeat this procedure 
and carry out all the Gaussian integrations iteratively by steepest descent, upon setting 
Ck = (mim2 ■ ■ ■ mfc)~^/^, which gives in leading order 

Ki ~ Qmim2...mi_imiki{z°,zi^,...,z'^_-^,z°) ^j^'j 
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kj(zi, . . . , Zj_i, Zj, . . . , zg) = kj^i(z^, . . . , Zj_-^^, Zj, 
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U > 1) 



ki{zi, 
giving for j > 1: 

kj(z^, 



In coshH(5i, 



■ ? ^j — 15 ^j' . . . , . 



In cosh 5(5°, • ■ ■ , z^_i, z 



31 1- 



i-1 



(7^ 



fc=l 



The identity 



(9 

— k (7^ ... =0 ~. . . . 



ttj tanhS(Z]^, 



) ^j— 1) ^j) ■ ■ ■ ) ^i) Zj 



shows that the values of all {zj} are ultimately to be solved from the following i coupled 
saddle-point equations: 

5° = tanh . . . , 5°) (j = 1, . . . , £) (79) 

We insert ( |77D and ( [75| ) into (|7^), and find that for rui oo the free energy per spin 
reduces in leading order simply to 



1 1 1 ^ 

/ - 2 ^1^1 ~ ^ log 2 + - X! gfcvrfcmim2 ■ ■ ■ mk-i{mk - 1) 



k=2 



1 



+ -g2vri(mi-l)-/5-^ 



lncoshS(5?,---,z°)--$:(5°)2 



A:=l 



(80) 



with H(50,...,50) =ELi5fc5°- 



We can now derive the saddle-point equations for nii — oo by variation of (^) 
with respect to the order parameters {qk}- Let us first derive the equation for qi in 
leading order: 



= -^, + -gi^i(m,-l)--g— ^ 
-ly^tanh" — — + 



1 



In cosh H — 7^ 



z. 



k=l 



(mi — > oo) 



The term with the partial derivatives d/dz^ is identical zero due to the saddle-point 
equations (0), and hence, upon working out the derivatives da^/dqi = Ck^da^/dqi and 
using ( |79D to eliminate occurrences of z^, we just retain in leading order 

= -7rimi[gi — tanh^ '='] + ■ ■ ■ (^i ~^ oo) 

Hence 



gi = tanh^ S (mi oo) 
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Figure 10. Properties of tlie equation q = Fx{q), wliere Fx{q) — tanli {xq'^)^ from 
wtiich to solve tiie mi —^ oo order parameter amplitude q* (see main text). Left 
panel: shape of the function Fx{q) for x € {1, 2, 3} (solid curves, from bottom to top), 
together with the diagonal (dashed) whose intersection with Fx{q) defines q* . Right 
panel: largest solution q* of the equation q = Fx{q) as a function of x^^. The jump 
occurs at q* « 0.7911 and x^^ « 0.4958. 



Similarly we can deal with the derivatives of / ( ^0|) with respect to the other qj. With 
the simple identity 

the saddle-point equation for with j > 1 is seen to become in leading order 



= -qjUjUii 



Pt^i dqj 

-ly^tanh" — — + 

P ^1 ^ddk dqj 



lncoshS--^(4°)' 

fc=i 



(mi oo) 



qjTijimi . 
TTjmim2 



_i(mj-l) - ^tanh^S Vmi . . .mfcOfcl^ + 



mj_i[mj — . 



j — l) — tanh^ sj + 



Hence, for all j > 1 one simply has 
qj = q* = tanh^ S 



mi 



oo 



The final stage of our argument is to determine the amplitude q* in (^T]). We note 
that, by virtue of {^^, we can write S = I]fc=i in leading order as S ~ FtanhS, 
where Y = Yll^i a\. It now follows, upon inserting (|8T|) into this relation, that g* is the 
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solution of 

g* = tanh2[Fv^ (mi ^ oo) (82) 

In working out the quantity Y in leading order for nii — oo we have to take care not 
to forget about the mi dependence of the factors vr^, defined in (|2^) . In particular, 

L 



+ E 



1 



f'j k=j+l 
Using this relation we find 

'i-i 

Y = (3q 



m 



j+i ■ ■ ■ "m-k /^fc 



TT 



j+lKj + T^tQ 
1 



-2 



+ 



(mi 



oo 



.i=i 

= Pq' E-+ E = - + 

Our final result on the limit mi — > cxo is the following: in the phase SG^ one has 
Qi = . . . = Qi = q* > and g^+i = . . . = ql = 0, where q* is the solution of 

= tanh2[/?u;,(g*)3/2] (83) 
^ e- ^ 1 e- 

E-+ E ... ... - (84) 

j=i /^j j=e+i 



m, 



We note that, for any tu^ > 0, equation (^) will have a non-zero solution (and hence 
phase SGi will indeed exist) when T is sufficiently low, and that liniT-^o <?* = 1- The 
behaviour of equation ( ^3]) as a function of the the effective control parameter x = [3uj(, 
is illustrated in figure llOl 



From (^,^) we can immediately extract the critical temperature T^^*, signaling the 
(first order) transition P —>■ SGg. The condition for nonzero solutions of ([83| ) to bifurcate 



follows from solving (|83|) simultaneously with the equation 1 
which leads us to the explicit and simple result 



dq' 



1st 



3001 g^l - q* 



q* = tanh^[; 



tanh^[(3ooe{q*n 



5) 



^3(1 -g-)^ 

Numerical solution of (|85|) shows that q* ~ 0.7911 and Tpf/u£ ^ 0.4958. In order to 
assess the dependence on i of the transition temperatures T^f , we subtract 



1st 



1st 



3g* 
3g* 



- 1, 



Q+l 
M^+l 



^ 1 

E — - 



Thus Tp^f/+i > Tp^e for m^+i > 1 

"list ^ 

s^+1 ^ -^p/ 



i.e. for relatively low noise levels in the level-(£ + 1) 
couplings), whereas T^^^^^^ < Tp^i for m^+i < 1 (for relatively high noise levels in the level- 
{£+ 1) couplings). Upon inserting the appropriate values of the control parameters, one 
can easily verify that the general results obtained in this sub-section regarding the values 
of the order parameters in the phase SGg and of the P SGi transition temperatures 
Tpf for arbitrary L are in perfect agreement with our solutions as calculated for the 
special choices L = 2 and L = 3 in previous sections. 
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7.2. The Limit mi ^ in the L-level Hierarchy 



We next turn to the limit mi 0, for fixed Ti (i.e. T ^ 0). We observed in the 
phase diagrams of figures ^ and ^ for L = 2 and L = 3 that along the line T = 
one finds critical values T^^f^ for Ti which signal the creation of phase SGg (where 
Qi > ■ ■ ■ > > and qe+i = . . . = qi = 0) from SGe-i (where gi > . . . > qe-i > 
and qi = . . . = qL = 0). In this subsection we calculate these critical values for the 
general L-level system. Our starting point is again expression ( [76|) for the free energy 
per spin (obtained by putting g^+i = . . . = q^ = 0). In order to make all occurrences of 
mi explicit, we substitute T = Timi, and we write the factors tt^ of ( p4D as 



with 



mi 



TTl 



^TT'^ m2 . . . m^' /i^/ 



so that 7r£ = (^(m^) for all £ as mi ^ 0. This gives 

mi/(gi, . . . , g^) = ^^1 - i^i(gi-l)2 + (^(m?) 



ni=2 "^fc 



logi^£ 



+ imi 



giTTi + ql'K2{mT-l) + E (ll'^km2 . . . mk-i{mk-l) 

k=3 



(86) 



Dz2 DziicoshSy 



mi_i \ mi 



m^'^S, S = ^ Zkak 

k=l 



ae = yTi ^qiTVi, ak<e = yTi ^{qk-^k-qk+iT^k+i) 
Since S = (9(m5) as mi ^ 0, by virtue of our definitions, we may conclude that 

{coshS}™^ =2-™i 



el"l(l + 0(mi)) 

''«2 ^ Tni_i >. nii 



Similarly one gets in leading order for mi — * 0: 

^ [dz, {coshH}-tanhS = ^^'^ ^^"^^^ 



(mi 0) 
+ . . . (87) 

(88) 



According to ( p6D the saddle-point value of qi is of the form gi = 1 — 0{y/rni). If, 
however, we substitute gi = 1 — K^mi + 0(mi) into (|86D , we find that the saddle-point 
obeys k = 0, hence the true scaling of gi is 

gi = 1 - Kmi + 0{ml) (89) 

Insertion of (|89D into (|B) gives 



"^1/(92, . . . , g^) = 7(1 + mi)7ri + 0{ml) - T^"^^ logi^^? 



qi = l 



+ lmi 



g^7r2(m2 - 1) + E ?fc^fc"^2 • • • mfe_i(mfe - 1) 

k=3 



(90) 
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and hence the mi — > saddle-point equations for the order parameters g^/ with 1 < i' < 
are given by 

2Ti 



d 

2Ti d 



(91) 
(92) 



(m^^i) (nr=2 ^k) (nL2 "^fc) 

with Ke{q2, ■ ■ ■ ,q£) = hmg^^i hnimi^o (as given by (p7D). At this stage it is 
advantageous to use our earher results (^,^), which in the present context and in 
combination with ( |55D translate into 

JDzi e'^l sgn(S 



q2 =(...( 

<lk>2 =(•••( 



(...( 



/ e'"! sgn(S 



)2...). 

)2 



1 2 



with 



■)k- 



)k ■ ■ ■)i 



(93) 
(94) 



{f), = ki,^ Dz,, k'^!:^f{zi,) 



k=l 



Working out the zi integrations in 



leads to 



JDzi el^l sgn(S) 


sinh(Si^ 


+ 


ie^iErf 


diV2 


- ie- 


=iErf 


af-Hi 
aiV2 




cosh(Si' 


+ 


ie^iErf 




+ |e- 


-Hi Erf 


" -2 " " 

a|-=i 


diV2 





(95) 



The transition value T/°i ^ for Ti is the one which gives a second order bifurcation of i 
away from zero in (P^. 

Let us work out these results first for i = 2. Here one simply has di 
iV^i ~ 12^2) I VTi and Si = Z2\fq^2T^I \fT[, with q2 to be solved from 



(l2 = ( 



sinh(Hi) + |e=iErf 


af+Hi 


- ie-^iErf 


d'f-r.1 


di\/2 


diV2 


cosh(Hi) + ie^iErf 


dj+Si 


+ ie-^iErf 




diV2 


diV2 



h 



(2? 



927r2 

Ti 



1 + Erf 


di 
.V2. 


+ d^e~'^'' + 0{^i) 


1 + Erf 


di 
.V2. 





1 



J7j_g-i*i/Ti 



1 + Erf 



+ 0(g; 



(96) 
(97) 



Hence the condition for the second order SGi — > SG2 transition, Ti = T^2'^, is to be 
solved from 
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Figure 11. Re-entrance phenomena in the second order SGi SG2 transition for 
L = 3 and m2 = 0.5. Left panel: phase diagram in the (Ti,r) plane. Right panel: 
value of the order parameter qi at the transition line as a function of Ti . In both cases 
the solid part of the curve indicates the physical part of the transition line; the dashed 
part indicates the non-physical (re-entrant) part. 



Equivalently, upon substituting = 7ri/2Ti: 



rT-i2nd 
1,2 




V vr 1 + Err [x\ 

Insertion of the parameter values appropriate to the L = 2 and L = 3 examples, as 
studied in detail in a previous section, sheds interesting new light on the nature of the 
jumps observed in the SGi — > SG2 transition lines of the L = 2 and L = 3 phase 
diagrams for small T: 



m2 
m2 



0.5 : 
1.5 : 



'jump ^ 



12.58, T( 



2nd 



Ti 



2.17, T( 



2nd 



9.884 
! 2.095 



These results indicate that for low T the SGi SG2 transition exhibits re-entrance, 
the extent of which decreases with increasing m2. In fact, we found another second 
order transition line from SGi to SG2 which shows re-entrance for each m2. See Figure 
11 and 12. On reflection, this is not entirely surprising, since for mi — one should 
expect replica symmetry to break. It has been observed frequently in many disordered 
systems (see e.g. [|13i) that replica-symmetric solutions show unphysical re-entrance 



phenomena in RSB regions (which are removed by the proper RSB solution). 

For general values of i we have to work out the following continuous bifurcation 
condition of qe 7^ 0, derived from equation (M): 



d 

1 = lim -— (. . . 



(...( 



sinh(Si) + ie"iErf 




- |e-^iErf 


-2 " 






cosh(E;i) + ie-iErf 




+ |e-^iErf 




aiV2 


aiV2 



)2...) 



)k ■ ■ ■)l 
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0.5 1 1.5 2 2.5 0.5 1 1.5 2 2.5 



Ti Ti 

Figure 12. Re-entrance phenomena in the second order SGi SG2 transition for 
L = 3 and m2 = 1.5. Left panel: phase diagram in the {Ti,T) plane. Right panel: 
value of the order parameter qi at the transition line as a function of Ti . In both cases 
the solid part of the curve indicates the physical part of the transition line; the dashed 
part indicates the non-physical (re-entrant) part. 



This is done in [Appendix C| , where we show that the value Tf^f^ for Ti which marks 
the continuous transition from SG^_i to SG^ is to be solved from 

e-i >t 



1 + K + J2^2--- mk-i{mk - l)qk 



(100) 



k=2 



where k = limmi^o(l — where = 0, and where for the values of the {qk} with 

1 < k < i one has to substitute the solution of equations (|93| , |9^ . The quantity n is 
calculated along the lines of our previous calculation of (|87D and (p^): 



^ _ 1 , , JDzi cosh-nS)[l-tanh^(H)] 

^ hm^(...(^^-- cosh-^-(HM) 

^1-0 mi ^ ^ JDzi cosh'"^(H/mi) ' ' 



(101) 



We know that = JDzi cosh'"i(S/mi) JDzi e'^l for mi 0. Let us calculate the 
term in the numerator in leading order. 

Dzi cosh'^^-^E/rm) = /+(Si) + /_(Hi) 



with 



>o 



Dzi cosh'"i-'(S/mi) 



5<0 



Dzi cos\r'-'{E/mi) 



^ D2i{e^/™i (1 + e-2^/™i)/2}'"i-2 

1 

^Dzi{e"^/'"i(l + e2^/'"i)/2}'"^-2 



Putting b = 2ai/mi, bn = nb, fixing mi to a small number, introducing a cut-off e and 
using (l + x)^"^ = J2^=o{^ + ^){~x)"' and the asymptotic properties of the error function 
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Therefore, 



Hence 



/^(Hi) = / ^D;2ie--(2/-i-i){(i + e 

di 

XD - 

^ D2ie-"(2/-i-i){(i + e-2=/-i)/2}-2(l + C>(mi)) 



"1 

5l 



4 lim 



"1 



E(n + l)(-re 

n=0 



n — 2nS/mi 



(l + 0(mi)) 



n=0 
oo 



2Hi 



4 lim y(n+l)(-)"e-^("+^-^)e'''("+i-'^)'/2 



n=0 



X -|l-Erf 



e - ^ + b{n + l- 



} + 



4 lim y (n + l)(-)"e ™i ^'^ ^ 2 ^g- - 2^/'^- ■ -v- - 2 
£^+0 ^ ^ ^ ^ ^ 



n=0 



27T e - ^ + b(n + 1 - 
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4 lim + 1)( — ) e "1 2 ai ^ ^ 2 > ^ ai' / 

1 1 

X ^ . H ^ + . . . 



£^+0 ■ 
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ai ' 6(n+l) 



1 
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27r6 ^-^+0 



lim e^^'"^'"^^ ^(-)"(e-^^)"+^(l + 0{m,)) + 



lim e 

-e ^ ' + 
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-be 



+ ... 



2'Kb 



mi -(=1)2/2 , 
e "1 + 
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We have now calculated explicitly all ingredients necessary for determining Tf^ff one 
is to solve equation ( |100[ ), upon insertion of the solution of equations ( p3| , |9^ ) for {qk>i} 
and of expression (|102|) for k. 

As a simple test one can verify the outcome of ( |100| ) for the case i = 2 which 
we analysed before. This corresponds to Si = 0, insertion of which into ( |102| ) and 
subsequently into ( |10U| ) indeed brings us back to (P^, as it should. 

8. Discussion 

In this paper we have studied self-programming in recurrent neural networks where 
both neurons (the 'processors') and synaptic interactions ('the programme') evolve in 
time simultaneously. In contrast to previous models involving coupled dynamics of fast 
neurons and slow interactions, the interactions in our model do not evolve on a single 
time-scale; they are divided randomly into a hierarchy of L different groups of prescribed 
sizes, each with their own characteristic time-scale T£ and noise level {i = 1, . . . , L), 
describing increasingly non- volatile programming levels. 

We have solved our model in equilibrium upon making the replica-symmetric (i.e. 
ergodic) ansatz within each level of our hierarchy, leading to a theory which resembles, 
but is not identical to Parisi's L-level replica symmetry breaking (RSB) solution for spin 
systems with frozen disorder. In addition to a paramagnetic phase, the phase diagram 
of our model involves a hierarchy of distinct spin glass phases SGe, which differ in terms 
of the largest time-scale on which the system (spins and couplings) will be found in a 
frozen state. Our theory involves L replica dimensions m^, reminiscent of the block sizes 
in Parisi's RSB scheme, which here represent ratios of the temperatures of subsequent 
levels in the hierarchy of equilibrating couplings, and which can take any value in the 
interval [0, oo). 

We have solved our order parameter equations in full detail for the choices L = 2 
and L = 3, leading to extremely rich phase diagrams, with an abundance of first-order 
transitions especially when the level of stochasticity in the interaction dynamics is chosen 
to be low, i.e. when one or more of the become large (which can never happen in the 
Parisi scheme, where always < < 1). We also studied the asymptotic properties 
of our model for arbitrary values of L in the limits mi —>■ oo for fixed T (deterministic 
dynamics of the level-1 interactions) and mi — > for fixed Ti (deterministic dynamics 
of the neuronal processors). This revealed further non-trivial properties, such as the 
universal nature of the values of the order parameters (i.e. Qk = (f ^ 0.7911 for all 
k < i, independent of the control parameters) at the first order P SG^ transitions 
for mi = oo, and re-entrance phenomena at the SGg-i SGg borders in the phase 
diagrams for mi = (the latter are likely to be replaced by discrete non-reentrant jumps 
when replica symmetry breaking is taken into account). 

In the present study we have not attempted to validate the predictions of our theory 
by numerical simulations. With the present CPU resources this would not have been 
possible, since our model requires L nested equihbrations of disordered sub-systems. 
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Even with fixed couplings it would not have been possible to reach equilibrium with a 
system size sufficiently large to suppress finite size effects; as a consequence, even for a 
similar L = 1 system it was already found to be impossible to carry out simulations which 
achieve more than a very rough qualitative agreement with the theory [|T0| . Experimental 
verification for a recurrent self-programming network with L > 1 will probably require 
hardware realizations. 

In retrospect, we found ourselves pleasantly surprised by the extent to which the 
present model allows for analytical solution, in spite of the complications induced by the 
nested equilibrations. Rather than being restricted by mathematical intractability, our 
problem was rather how to select the control parameters for which to show full phase 
diagrams. This allowed us to gain qualitative and quantitative insight into the structural 
properties of simple recurrent self-programming systems, in particular regarding the 
quesntions of when and how these systems switch from random motion of processors 
and programme (the paramagnetic phase) to states where processors and some (or all) 
of the levels of the hierarchy of programme routines are 'locked' into specific fixed-points 
(the different types spin-glass phases). 

At the same time it will also be clear, however, that both in terms of understanding 
the physics of realistic self-programming systems and in terms of understanding 
the mathematical theory by which they are described, this paper represents only a 
modest step. In realistic self-programming systems one should obviously expect the 
programming levels not to evolve only on the basis of pair-correlations in processor 
states, a simple decay term, and Gaussian noise, but one would as a minimum introduce 
external symmetry-braking forces into both the processor dynamics and the coupling 
dynamics, representing data to be processed and programming objectives to be met, 
respectively. At a theoretical level it would be interesting to investigate the form taken 
in the present model of replica symmetry breaking, for which we have already found 
indirect evidence (in the form of re-entrance phenomena) in studying the mi limit, 
by calculating AT lines [|15|. Since in our present model the replica symmetric (RS) 
theory is already similar to an L-step RSB theory a la Parisi, it is not immediately 
obvious what structure to expect when replica symmetry is broken at one or more levels 
in our hierarchy. These and other questions and extensions will hopefully be addressed 
in future studies. 
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Appendix A. Asymptotic form of Tf'^'^ when nii ^ 1 

In this first appendix, we derive the asymptotic form of the transition temperature T^^'^ 
for the case where mi ^ 1. The value of Tfg*^ is determined by solving the coupled 
equations 

1 = V%^[l + (mi-l)gi], (A.l) 

qi = — [ DziCosh'^^{aiZi)tajih^{aiZi), (A. 2) 

Ki J 

where oi = -y/^vFigi. Upon assuming gi <^ 1 and mi ^ 1, we can derive from ( |A.2|) the 
equation for q = migi to take the form 

1 ^ V^[l + /37rig(l + g)]. (A.3) 

From ( [A.l|) and ( [A.3| ) we subsequently obtain the following equations for the quantities 



w = l/vT^TT^ and g, 

q =w-l, (A.4) 
g{w) =w^ - aw + b = 0, (A. 5) 

where a = + |^), b = (f^)^ and vfj = miHi, both of which are independent of 
mi. From vfi = + ^ it follows that g{l) = 1 — |^ < 0. Thus g{w) = has the 
unique solution w*, which is greater than 1. Therefore we obtain our desired result for 



gi ~ ^ = — (u;* - 1) > 0, (A.6) 

mi mi 



mi — i> oo: 



T-^aw^Ti. (A.7) 

Appendix B. Building Blocks of the General Saddle-Point Equations 

In this appendix we calculate the derivatives used in deriving the saddle-point equations 
for general values of L in section 4.4. In this and subsequent appendices it will be helpful 
to define a number of convenient short-hands (further notation is as in section 4.4): 



Mi>o =11"^';^' Mo = 1 



k=l 



i'£>o = (. . . (tanhS)i . . = tanhS 

Appendix B.l. Calculation of K^^dKi/dE and Ji = Kl^d{K£ipi)/d'E 
We first calculate K^^dKe/dE for i > 1: 

5ir,_i 



dE 
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J DziK'pJ-' J Dz^.^Kf'-''^ ■■■ Jdzi cosh 



= M^ (■••(tanhS)i---)^ = M^^£ 
Next we calculate = K'^^d^Kiipf) /d'E. for £ > 1. We commence with Ji: 

= ^ J Dzi K^' [l + (mi - 1) tanh^ S 

= 1 + (mi - l)(tanh^E:)i 

We move on to £ > 1, abbreviating = K^^dK^/d'E: 

d 



E sinh H 
(B.l) 



(B.2) 



J, = Ki' J Dz, —{KZ\-'Ke-iiJi-i: 



dE "^-^-^-^ ' "^-i dE 
= Ki' J Dzi {{me - l)K'P_\Le-i^e-i + Kt\Ji-i} 
= {me - l){Le-iiJe-i)e + {Je-i)e 
= M,_i(m, - l){^ti)e + {Ji-i)e 
Iteration of this relation gives: 



Ji=J2 Mk-i{mk - . . (V'Li)fe ...)£+(••• {Ji)2 . . .)i 

k=2 

e 

= J2 Mk-i{mk - . . (V'Li)fc ... )i + I + {mi -!){■■■ (tanh' H)i ■ ■ 



k=2 



l + ^Mfc_i(mfc-l)(...(V^ti)fc...), 
fc=i 



(B.3) 



Finally we prove that Ji > for all £ > 1. We put qk = {. . . {ipl_i)k . . .)e and use the 
inequahties gi > (3'2 > • • • > > 0: 

Je = ^(Mfc - Mfc_i)gfc + 1 + (mi - l)gi 

k=2 
i-1 

= Mk{qk - Qk+i) + MiQi - miga + 1 + (mi - l)gi 

k=2 
t-1 

= Mk{qk - Qk+i) + Miqi + mi(gi - 52) + 1 - gi > 

k=2 

Appendix B.2. Calculation of dKi/dqe' 

In this second part of [Appendix B| we will repeatedly need the following simple relations: 

, dE 



5^ = 2^"^^^W ' 



dqi>i 2 I dzi 



dzi_i- 



(B.4) 
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We first calculate dKe/dqe for !<£'<£: 
dKe f ^^_idKe_i 

= 1 n mt]fDztKTX' fDzt.iK'^:!^'-^ 
k=e'-i 

= [ n rnu]! DztKZr' ..J Dz^K"^!:-' f Dze^^.K^^^^'' 
k=e'-i J J 

...jUz^i J UZi'^lK^,_2 



^ k=l'-\ 

Hence, upon using the relation Kj^dK^/ dE = Mgip^, we obtain for 1 < < £ the simple 
result: 

^e^^^ = ^kjlYl mj]{me - !)((. . . {'i/je-i{ipe-2)e'-i)e' ■ ■ ■)e-i)e 

= ^M,M,,_^{me - !)((. . . ■ ■ (B.5) 

For i' — 1 < £ we obtain, similarly: 

dKe-i 

-ft- e 



J DzeKZ\- 



——jDz,K,_, jDz,_J<,., ...jDz,K„ — 

2 Ki 
2 



JW-..jDz.Kr-^-^z.0- 
jDzeKTX'---jDz,^\Kl 
j DztK'^J-^ . . . y^^i {l + (mi - 1) tanh^ s} K^' 
M, {l + (mi - 1)(. . . (tanh^ S)i . . .),} (B.6) 
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Next we turn to the case where i' > i, noting that Ki is a function of {-z^+i, ■ ■ ■ z^}. If 
i' > i + 1 one finds 



dqe' 



1 dKe 
Kf dE 



- \^ze'{dE/dzi') ^ - Zi'^i{dE/dze'^i) ^| 

- \^Zi>{dE/dzi>y^- zi'-i{dE/dzi>^iy^^ Mi^pi 



For 



+ 1, on the other hand, we obtain 



= jDz,KTX' {z,^.{dE/dz,^,r-z,{dE/dz,r] ^ 



+1 



dE . 
dza+i ' 



92 



as 



This latter term will appear inside an integral over zi+i whenever g^+i > 0. Thus, 
we will at some point have to evaluate integrals of the following form, with a function 
g{E{zi+i,---,ZL)): 



j Dze+ig{E 



j j m.Kti^"-^ (B,7) 



We calculate the derivative in the second term of dKi/dqi^i as follows: 



(me - l)Kl\Me^,^l, 



Upon using formula (| B.3| ) we arrive at 

-1 A 
dE 



as 



i + ^M,_iK--i)(---(^|_^---Vi 



Hence 



and therefore 



{ze+iidE/dze+i)-'KeMe.i{^lJe^i)e - KeMe-iJe} 



Me-iTUi ^Zi+i{dE/dzi+i) - Je] 



(B.8) 
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Appendix C. Condition for Second-Order SG^^i — > SGe Transitions 

In this Appendix we derive the condition for the second order transition SGe-i to SGi, 
for arbitrary values of 1 < i < L. We generahze our previous notational conventions, 
and write the general saddle-point equations as 

qe = ^eiqi,---,qL), (£=1,...,L) 
Similarly we define, for 1 < k < £: 

Note that, with these conventions, ipk{qi, ■ ■ ■ , ?l) = (■ ■ ■ {'~pt^)(.+i ■ ■ The second order 
SGi^i — > SGj^ transition temperature is defined by 



\{qe-l>0; g^=g^+i = ...=qr^=0) — 1 (CI) 



We can write (Pi'\qi, ■ ■ ■ ,qL) as (pf^ = K^^ JDz£K^iiljj_i = {i(jj_i)£, with i/je-i 
{. . . (tanhS)i . . Prom this expression we obtain 



dqe Ki dqi Ki J dqe 

_ 1 dKe (e) , - 2 /• _^dKe-i 2 



me- 1 gCA^.i 
Ke dqe Ke J dqe 

'dqe 



+ 



1 dKe (e) .me-2 r r^mi-^dKe-i. ,2 
Ke dqe Ke J dqe 

^ /D^,|(9S/9z,)-i|-(ArrV.-i)} jDze-,-^[Kl%-'i^e-2. 
/ Dze |(m, - 2) A-r^^^.-i + KTX'^iKe-.^e-.) } 



A 



(9 

X -^[Ke-iil^e-i] 



I dKe {e) . , ^dKe-i 2 \ 



Kedqe^' 

+ Pneime - '2){Kl\ ^~ iJe-i-^{Ke-iipe-i))e 
+ Pne{Ki^A^[Ke-ii^e-i]\ )e 
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For i > 1 this reduces to 



Ki dqe ^'^ " ' dE 
Kg dqe 

+ {nii - 2)^m£_i({(m^ - 3)M^_iV'|_i + 2iJje-iJi-i} {Me_2tlJe-2) e-i) e 

^ {-MeMe-i{me - + 2{m, - 2)m£_iM,_2(d Jf-i)^ 

+ (m£ - 2)m^^iM£_2(m£ - 3)M^_i(^/'^_i)£ 
+2(m, - 2)M,_i(^,2„i J,_i), + 2(J2_,),} 

^ {-M,M,_i(m, - l)(v^fV + 4K - 2)M,_i(d J,_i), 

+ K - 2)m,_iMf_2(m, - 3)M,_i(^ti), + 2(Jii),} (C.2) 



whereas for 1 = 1 one finds 



1 








1 


dKi 


Ki 


dqi 


1 


dKi 




dqi 



,2^1 



dq 

1 



(1) , /^^i 1 /".^ 9' 



2 K 

The second derivative of -K"™^ tanh^ S is given by 

^2 n 

^ tanh^ = [i^i - 2) cosh mi - 3S sinh^ S + 2 cosh^^-^ S sinh S 

= cosh™^ S [(mi - 2) (mi - 3) tanh^ E + (5mi - 8) tanh^ H + 2 
Insertion of this expression, and using ( [B.6| ), we now arrive at 

{-mi(mi - 1)(^S^V + (^1 - 2)(mi - 3)(tanh^S)i 

+4(mi - 2)^^'^ + 2} (C.3) 



dqi 2 
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Finally we note that the property qe = induces the simplifying relations = ipe-i = 
0, with which expressions ( |C.2| ) and (|C.3| ) lead to 



dqe 



£ 



\{qe-i>0; qi=qi+l = ---=QL=0) — P'^iJg-l 



Together with ( |B.3| ) we can now work out the condition ( |C1| ) for the second order 
SGf-i SGi transition explicitly, giving the final result: 

y^jl + E Mfc_i(mfc - l)gfc| = 1 (C.4) 

Appendix D. Derivation of Partial Derivatives for L = 2 and L = 3 

In this appendix we will find it convenient to use the following abbreviations: 

¥^1(91, 92, g2) = (((tanh^ 2)1)2)3 

^2{qi,q2,q3) = (((tanhS)^)2)3 

^siququqa) = (((tanhH)i)2)3 

(these are the right-hand sides of the L = 3 saddle-point equations for {qi, q2, qs}), 

^i\(li,(l2,q3) = (tanh^H)i, Vi\qi,q2,q3) = ((tanh^ 2)1)2 

<^2\<li,<l2,q3) = (tanhH)i, <^?\qi,q2,q3) = ((tanhH)i)2 

f3\(li,(l2,q3) = ((tanhS)i)2 

and also ipe = (. . . (tanhH)i . . Note that {ip^j}^)2 = ^k'^ = {'^'k'^)3 {k = 1,2,3), 
tjjf = (y92^^ and ip2 = V^3^^- Further notation in this appendix is as in sections 4 and 5 of 
the main text and as in the previous appendix. 

Appendix D.l. Building Blocks of the Partial Derivatives 

First, we calculate the derivative of ^i^\qi,q2iq3) with respect to qi. From the general 
formula ( p.3|) we obtain 



d<^i^ /5vri r (1) 2 



+ (mi -2)(mi -3)(tanh^S)i +4(mi -2)(/?S^^} (D.l) 

Next we turn to the derivative of ^2'\qi, Q'2, Q'3) with respect to ^2- The general formula 
( |C.2|) with k = 2 can be simplifid by using ( p.3|) : 

M! = ^ {-M2mi(m2 - l)(^f )2 + m?(m2 - 2)(m2 - 3)(^^)2 
+4mi(m2 - 2)(V^iVi)2 + 2(7^)2} 
= ^ {-m^m2(m2 - l){'f2^Y + m^(m2 - 2)(m2 - 3)(^^)2 

+ 4mi(m2 - 2)(/?f^ +4mi(mi - l)(m2 - 2)(^i2(tanh2 2)1)2 

+2 + 4(mi - l)ipf^ + 2(mi - l)2((tanh2 3)1)2} (D.2) 
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The third partial derivative which we will need is 

+ (tanh-).^(|-(tanh-)0 

The last term in this expression is found to be 

(^)2 = ^{-m,(m,-l)((tanh^S)?)2 

+ (mi -2)(mi -3)((tanh'S)i)2 + 4(mi -2)(^f^ + 2} 



1 


dK2 


K2 


dqi 


1 


dK2 




dqi 


1 


dK2 


K2 


dqi 



Thus 



^ - ^ {4(m, - 2)^?) + 2 - M2^f^ - {mi - IjM^l^f 



dqi 2 

+ mim2([l + (mi - l)(tanh^ S)i](tanh^ 2)1)2 

- mi (mi - l)((tanh2 E)l)2 + (mi - 2)(mi - 3)((tanh^ 2)1)2 
+ (mi -2)(mi -3)((tanh^5)i)2 + 4(mi -2)(^f^ + 2} (D.3) 
Similarly we calculate the fourth relevant partial derivative: 
d^f'^ 1 dK2 (2) If- d 



^ ^ +— [Dz2^[K^'-' [DziCOsh^'Eteinh'E] 

dq2 K2 dq2 K2 J dq2 J 

' ^%f) + (,n2-l)^ lDz2Kr-'f^Ki{tanh^E)i 

Ko J doo 



K2 dq2 K2 J dq2 

+ — f Dz2KV'^-^ I Dzi^[cosV^' Htanh^ S] 
K2J J dq2 

- ^mlm2{m2 - l)(V'i)2¥'f^ + (^2 - 1) ^^^^ j Dz2 

d r dK 

X ^[i^;"2-^(tanh2 5)i]. /L»^icosh'"i-iS^ 
d:i J d:i 

+ ^fDz2Kr-'^ /D.i(^-^)|.(cosh-Stanh^S) 
K2 J 2 J a2 ai din 

3^2 f 1 f dK^-' d , 12. (2) (2) 

— I — y Dz2 — — — [Xi(tanh =,)ij - m^m2[m2 - l)</?2 Vi 

+(m2 - 1)^ /Dz2Xi^i^[i^r-^(tanh2S)i]| 



In this expression we need to calculate the following two objects: 
A[xp-i(tanh^5),] = ^[i^--2i^,(tanh2 5)i] 

= (m2 - 2)^Kr"'^i(tanh2S)i + i^r"' ^ [^1 (tanh^ S)i] 
= K^^ I (m2 - 2)miV'ii^r^(tanh^ S)i + K''^ -^[Ki{i8CQh^ S)i] 
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and 

d r n 

— [Ki (tanh^ S) i] = i^i [(mi - 2) (tanli^ S) i + 2 (tanh H) i 

(2) 

Insertion of these intermediate results into our previous expression for dipl /dq2 gives 



dip? /37r2 
dq2 2 



mi{m2 - 1) |-mim2V22^Vf^ + "^i("^2 - 2)(-?/'i(tanh^ 2)1)2 
+2(^1 ((mi - 2)(tanh=^S)i + 2(tanhS)i))2} 

= ^-mi(m2 - 1) |-mim2V?2^Vf^ + "^i("^2 - 2)(-?/'i(tanh^ 2)1)2 

+2(mi - 2)(7/;i(tanh3S)i)2 + 4y.(')} (D.4) 

From this last result one immediately obtains also the remaining partial derivative 

dipf^ aidiff^ 7ri(mi — 1) dip'i' 
dqi a2 dq2 7r2mi(m2 - 1) dq2 

= ^{mi - 1) {-mim2V?f V2^^ + "^i(m2 - 2)(V^i(tanh^ 2)1)2 

+2(mi - 2)(^i(tanh=^S)i)2 + 4(^f } , (D.5) 

where ai = ^M^_i(m^ - 1). 

Appendix D.2. Partial Derivatives of the Saddle-Point Equations 

Here we calculate all partial derivatives of the form dipe{qi,q2,q3)/dqe', with G 
{1,2,3}, which play a role in our bifurcation analysis of the L = 2 and L = 3 saddle- 
point equations. 

Calculation of dip^ / dq^ : 

Starting from the general formula ( |(J.2D 

^ = ^ {-M,M2{m, - + (ms - 2)m2mi(m3 - 3)M2(V2')3 
+4(m3 - 2)M2(V^2''^2)3 + 2(72^)3} 



we derive 



{-M3M2(m3 - l)ipl + (m3 - 2)m2mi(m3 - 3)M2(V'2)3 



dp3 _ PT[3 

dqs ~ 2 

+ 4(m3 - 2)M2((V^2')3 + (mi - l)(7A2((tanh2 2)1)2)3 
+ mi(m2-l)(^2'(^?)2)3) 

+2((1 + (mi - l)((^o')i)2 + Mm2 - 1)(V^?)2)')3} 
= ^ {-M3M2(m3 - l)ipl + (m3 - 2)m2mi(m3 - 3)M2(V'2)3 

+ 4(m3 - 2)M2((^3 + (mi - l)(V^2'((tanh' 2)1)2)3 

+ mi(m2 - 1){iIjI{iIjI)2)3) + 2 + 4(mi - l)ipi + 4mi(m2 - l)ip2 
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+2(mi - l)2((((tanh2 ^)i)2fh + 2m?(m2 - lfml)2)% 
+4mi(mi - l)(m2 - l)(((tanh' S)i)2(V'i)2)3} (D.6) 

Calculation of dif^/dqi : 

dqi Ks dq, kJ ' 

K3 dqi K3 J dqi 

1 dK, 'm,-2 r.rn.-?dK: 



+ 
+ 



- -TT^^^ + K - 2 t 3 + 2 m2 - 1 V^2^^V'i 2 3 

A3 dgi A2 oq\ Ki dqi 



1 dK3 , , 1 5/^2 _,2\ , ^/___ IN/ . / 1 -^iTi 



V93 + (ma - 2)(— — ^^2)3 + 2(m2 - ^^1)2)2 



Ks dqi K2 dqi Ki dq 

The second derivative 5^(i^i(^o)i)/'9S^ in this expression is calculated as 
^(i^i(V'o)i) = /L'^i^[cosh--^5sinh5] 

= J Dzi [(mi-1) (mi-2) cosh'^i-^ 5 sinh^ 5 + (3mi-2) cosh'"!"^ 5 sinh E 

= ((mi - l)(mi - 2)(tanh^S)i + (3mi - 2)V'i) 
Insertion into our previous expression for dcps/dqi gives: 

dqi K3 dqi K2 dqi Ki dqi 

+ ^ {2(mi - l)(mi - 2)(^/^2((tanh^ 2)1)2)3 + 2(3mi - 2)(^2(^i)2)3} 
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Upon using our previous result ( |B.6| ) of [Appendix B| , this subsequently translates into 
^ = ^ {-M3</^3 - - l)ip^ip^ + (ms - 2)M2{iIjI)^ 

+ (mi-l)(m3-2)M2(<^fV2)3 

+ 2mi(m2 - l)(V^2(^i)2)3 + 2mi(mi - l)(m2 - l)(V'2((tanh^ 5)17/^1)2)3 
+2(mi - l)(mi - 2)(^2((tanh3 2)1)2)3 + 2(3mi - 2)(V'2(V'i)2)3} 

= ^(mi - 1) {4(^3 - M3<^i<^3 + (rns - 2)M2(<^fV2)3 
+ 2mi(m2 -l)(7/'2((tanh2 2)1^1)2)3 

+2(mi-2)(^2((tanh3 2)1)2)3} (D.7) 
Calculation of dip^/ dq2: 

dq2 dq2 K3 J dq2 

1 9i^3 , ^3-2 r _^dK2 2 

= - -FT^^^^ + —f? — / Dz^K^ ' -K—{K2'^2) 
Ks dq2 K3 J dq2 

+ Dz,Kr-'i,2 J Dz2^^iKr~'KM 



2 



. -^3 + "^^^ [Dz,KT^~'^{K2^P2) 

K3 dq2 K3 J ' ' dq2^ ^ ' 

+ Idz,KT-H2 fDz2Kr-^f^K,^. 

K3 J J dq2 

+ Dz3i^2™^" V2 / Dz2Kr-' J Dz,^^-^{K^^^o) 



K3 J dq2 



K3 dq2 K3 J dq 

- T^ll /"-'^■""-^■^ '^^ 

K3 J J dq2 



J Dz3K^'-'^2 J Dz2{m2 - l)K^^-'-^K,J, 



2 K 

1 a/sTs , ^, , 1 0X2 ,2. 



(^3 + (m3-2)(— — ^^2); 



K3 dq2 K2 dq 

+ 2(m2 - l)(V^2(^^^i)2)3 + ^2mi(m2 - l)(V^2(^i ^1)2)3- 
Ai oq2 ^ 
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Here we require the following object: 
, 1 dKi 



Ki dq2 K2 



dq2 



dl 



1 /?vr2 

— mi 

K2 2 



j Dz2K'^' 
X JdziK^' tanhS 



, 1 9Ki 1 , 1 9 , , 1 



^1 — ( 
mi 



mi{m2 - 2)0^1)2 + {JM^. 



Insertion into our earlier expression for d(p3/dq2, followed by usage of (|B.5| - [B.8|) whenever 
appropriate, allows us to write 



dips 
dq2 



I dKs ^ , 1 dK2 .2. 

-ifs + (ma - 2)( — ^— ^^2/3 



K3 dq2 



'K2 dq2 



+ 2mi(m2 - 1)^(^2 {mi(m2 - 2)(^3^2 + {^1)2})^ 



+ 



/57r2 
2 

1 dKs 



+ 



^3 ^92 
2mi 

/97r2 



2mi(m2 - l)(V'2(V'i^i)2)3 



+ 2m;(m2 - l)(m2 - 2)%«.2(i/'?)2>i 



4mi(m2 



2(^1)3)3 + (mi - l)(^2(^i(tanh2 2)1)2)3.} 



/3vr2 



(m2 - 1) {-Mgmiv^aV^s + M2mi(m3 - 2){{ipl)2i)l)i 



+ 2m2(m2-2)(^2(^?)2)3 

+4miV93 + 4mi(mi - l)(V'2(V'i(tanh^ 2)1)2)3} 



(D.8) 



Calculation of dipi/dqs and dip2/ dq^: 



These two partial derivatives are found to be relatively easy to calculate, and come out 
as follows: 

d(pi _ az_d<fz_ _ 7r3Af2(m3 - 1) dip^j 
dqs ai dqi vri(mi - 1) dqi 

= ^M2(m3 - 1) {4y;3 - M3</^i</^3 + (^3 - 2)M2((^f ^2)3 

+2mi(m2-l)(^2((tanh2 2)1^^1)2)3 + 2(mi-2)(V^2((tanh3 2)1)2)3} 

(D.9) 
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dip2 _ a^dip^ _ 'K^M2{mz - 1) d<^z 
dqz (X2 dq2 7r2Mi(m2 - 1) dq2 

= ^^2(7713-1) |-M3mi(/72</?3 + M2mi{ms - 2)((V'i)2V'2)3 + ^ruicps 

+2ml{m2 - 2){^2{^l)2)3 + 4mi(mi - l)(V'2(^i(tanh2 2)1)2)3} 

(D.IO) 

Calculation ofd(f2/dqi and d(fii/dq2: 

difi 1 dKs 1 r (9 



dq2 K3 dq2 J dq2 

A3 dg2 -f^ 3 -f^2 oq2 J oq2 

^^2,. . -.x , ,1 (2). , , d'^l\ 

= —Mzmi[vfi2 - l)93i<^2 + m3{—— — ipl ')3 + (— )3 

Z A 2 0*52 0'?2 

= ^M3mi{m2 - l)(-</?i</72 + (</'fV?^)3) 

+ (^-^^i("^2 - 1) { -7^17712(^1^ Vi^^ +77ii(77i2 - 2) (V^i (tanh^ S) 1)2 
+2(7711 - 2)(V'i(tanh^ S)i)2 + 4(^?^})3 

= ^7711 (7712 - 1) {-M3(/?i(/?2 + 777i77l2(77l3 - 1) ((/^f V2^^)3 + 4</72 

+77ii(77i2 - 2)((V'?(tanh2 5)1)2)3 + 2(7711 - 2)((^/^i(tanh' 2)1)2)3} 

(D.ll) 

From this result, in turn, immediately follows 

9v?2 OL\d^)\ /Ti(mi — 1) 

dqi a2 dq2 7121711(1712 - 1) dq2 

= ^(77li - 1) |-777i77i277l3(/7i(/72 + 77li77l2(77l3 - 1) ((/^f V2^^)3 + 4(/?2 

+7711 (7712 - 2)((V'i'(tanh2 2)1)2)3 + 2(77ii - 2)((V'i(tanh=^ 2)1)2)3} 

(D.12) 

Calculation ofd(fi/dqi and d(fi2/dq2: 

Finally, let us turn to the remaining two partial derivatives: dipi/dqi and dip2/dq2'- 

difi 1 9^3.. , 1 fr^_, d r^^^,, (2). 



dqi K3 dq 



1 r f) 



K3 J dqi dqi 



/5vri 



{-M3 {1 + (77ii - l)<^i} <^i + M3({l + (7711 - 
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- (mi - l)M2{{ip?^f)3 + mi(mi - l)(m2 - l)(((tanh2 S)?)2)3 
+ (mi - 2)(mi - 3)(((tanh^S)i)2)3 + 4(mi - 2)(y.p))3 + 2} 

= ^ {-K - l)M3(^i)' + (mi - l)M2(m3 - l){iv?f)3 
+ mi(mi - l)(m2 - l)(((tanh2 2)2)2)3 

+ (mi - 2)(mi - 3)(((tanh^ 2)1)2)3 + 4(mi - 2)<f, + 2} (D.13) 

where we use ( p.3| ), and, similarly, using ( p.2| ) 

9^2 1 dK^ 1 r d (2) 

yg2 ^3 i^3 J dq2 



- ^M3mi(m2 - 1)(V52)^ + m3(^M2mi(m2 - l)v52^V?^)3 

+ {-m2m2(m2 - l)(v^?y + m?(m2 - 2)(m2 - 3){^t)2 

+ 4mi(m2 - 2)ipf^ +4mi(mi - l)(m2 - 2)(^^(tanh2 2)1)2 
+2 + 4(mi - l)ipf^ + 2(mi - ifiitanh" E)l)2})3 

^ {-M,m,{m2 - l){v2f + m>2(m2 - l)(m3 - l){{v?f)3 
+ m2(m2-2)(m2-3)((^t)2)3 

+ 4mi(m2 - 2)v92 + 4mi(mi - l)(m2 - 2){{ijf{tanh'^ 2)1)2)3 

+2 + 4(mi - l)(^i + 2(mi - l)2(((tanh=^ 2)^)2)3} (D.14) 



